-- Logs begin at Wed 2022-08-24 15:53:26 UTC, end at Wed 2022-08-24 17:15:05 UTC. -- Aug 24 16:39:15.294862 dv-cinder-852208-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 16:39:15.303412 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 16:39:15.305385 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 16:39:15 2022] *** Aug 24 16:39:15.305385 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 16:39:15.305385 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 16:39:15.305385 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: nodename: dv-cinder-852208-9-iscsi Aug 24 16:39:15.305385 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: machine: x86_64 Aug 24 16:39:15.305385 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: clock source: unix Aug 24 16:39:15.305385 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: pcre jit disabled Aug 24 16:39:15.305385 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: detected number of CPU cores: 4 Aug 24 16:39:15.305385 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: current working directory: / Aug 24 16:39:15.305385 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: detected binary path: /usr/bin/uwsgi-core Aug 24 16:39:15.306192 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: your processes number limit is 47680 Aug 24 16:39:15.306192 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: your memory page size is 4096 bytes Aug 24 16:39:15.306192 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: detected max file descriptor number: 2048 Aug 24 16:39:15.306192 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: lock engine: pthread robust mutexes Aug 24 16:39:15.306192 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: thunder lock: enabled Aug 24 16:39:15.306192 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 16:39:15.306192 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 16:39:15.344276 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: Python main interpreter initialized at 0x5637a0a3c9c0 Aug 24 16:39:15.344276 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: python threads support enabled Aug 24 16:39:15.344276 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: your server socket listen backlog is limited to 100 connections Aug 24 16:39:15.344276 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: your mercy for graceful operations on workers is 90 seconds Aug 24 16:39:15.344640 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 16:39:15.344718 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: *** Operational MODE: preforking *** Aug 24 16:39:15.344975 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: *** uWSGI is running in multiple interpreter mode *** Aug 24 16:39:15.344975 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: spawned uWSGI master process (pid: 112672) Aug 24 16:39:15.345165 dv-cinder-852208-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 16:39:15.346524 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: spawned uWSGI worker 1 (pid: 112673, cores: 1) Aug 24 16:39:15.346524 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: spawned uWSGI worker 2 (pid: 112674, cores: 1) Aug 24 16:39:15.346524 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 16:39:16.003526 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 16:39:16.008767 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 16:39:17.091399 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:39:17.091399 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: from cryptography.utils import int_from_bytes Aug 24 16:39:17.092087 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:39:17.092087 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: from cryptography.utils import int_from_bytes Aug 24 16:39:17.095400 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:39:17.095400 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: from cryptography.utils import int_from_bytes Aug 24 16:39:17.095847 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:39:17.095847 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: from cryptography.utils import int_from_bytes Aug 24 16:39:19.614489 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:39:19.615161 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:39:19.615514 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:39:19.615612 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:39:19.615705 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:39:19.615788 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:39:19.615868 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:39:19.615948 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:39:19.616029 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:39:19.616122 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:39:19.616205 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.616328 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.616548 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.616679 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.616844 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.617004 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.617160 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.617326 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.617486 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.617655 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.617793 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.617966 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.618110 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.618286 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.618427 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.618608 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.618751 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.618937 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.619030 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.619198 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.619296 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.619517 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.619616 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-9-iscsi {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.619844 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-9-iscsi {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.620219 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.620308 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.620554 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.620654 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.620881 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.620999 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.621202 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.621292 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.621505 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.621598 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.621824 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.621910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.622127 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.622221 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.622618 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.622727 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.623062 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.623179 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.623365 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.623468 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.623677 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.623769 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.624013 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.624124 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.624323 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.624452 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.624658 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.624768 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.624976 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.625071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.625282 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.625378 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.625604 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.625706 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.625910 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.626019 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.626307 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-9-iscsi {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.626404 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-9-iscsi {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.626624 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.626727 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.626934 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.627029 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.627245 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.627356 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.627650 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.627776 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.627960 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.628066 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.628266 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.628361 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.628610 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.628706 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.628933 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.629044 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.629239 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.629326 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.629561 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.629656 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.629893 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.630044 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.630195 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.630289 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.630530 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.630664 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.630814 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.630903 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.631118 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.631252 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.631423 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.631510 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.631738 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.631831 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.632035 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.632132 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.632625 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.632721 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.632873 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.632967 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.633179 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.633273 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.633497 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.633583 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.633815 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.633901 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.634132 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.634222 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.634380 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.634483 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.634627 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.634716 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.634943 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.635036 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.635260 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.635355 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.636094 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.636196 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.636415 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.636514 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.636729 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.636826 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.637032 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.637119 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.637338 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.637423 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.637668 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.637764 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.637945 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.638032 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.638248 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.638344 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.638562 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.638655 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.638874 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.638982 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.639194 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.639304 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.639498 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.639670 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.639814 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.639902 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.640208 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.640314 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.640478 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.640570 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.640785 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.640888 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.641120 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.641219 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.641435 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.641523 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.641740 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.641835 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.642059 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.642150 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.642374 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.642461 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.642677 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.642765 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.642981 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.643070 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.643285 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.643372 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.643601 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.643688 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.643929 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.644016 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.644231 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.644334 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.644501 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.644591 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.644802 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.644898 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.645104 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.645192 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.645419 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.645506 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.645724 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.645813 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.646029 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.646117 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.646334 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.646430 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.646630 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.646715 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.646933 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.647018 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.647242 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.647338 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.647550 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.647644 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.647858 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.647950 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.648165 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.648267 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.648502 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.648620 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.648811 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.648917 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.649116 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.649221 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.649418 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.649520 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.649730 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.649831 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.650048 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.650155 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.650354 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.650457 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.650654 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.650741 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.650958 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.651051 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.651822 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.651989 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.652132 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.652276 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.652460 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.652616 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.652768 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.652925 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.653070 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.653211 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.653372 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.653526 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.653670 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.653807 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.653976 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.654116 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.654265 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.654407 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.654572 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.654711 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.654889 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.655028 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.655174 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.655309 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.655477 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.655618 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.655791 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.655928 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.656095 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.656239 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.656383 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.656537 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.656712 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.656800 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.657016 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.657103 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.657321 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.657409 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.657622 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.657717 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.657923 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.658019 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.658225 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.658318 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.658519 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.658614 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.658833 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.658929 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.659151 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.659237 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.659459 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.659566 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.659759 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.659848 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.660063 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.660150 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.660379 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.660548 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:39:19.660735 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.660824 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.661066 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.661155 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.661407 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.661502 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.661720 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.661813 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.662050 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.662147 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.662379 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.662480 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.662696 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.662783 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.663010 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.663097 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.663323 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.663417 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.663651 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.663746 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.663966 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.664134 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.664280 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.664368 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.664621 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.664709 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.664941 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.665042 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.665259 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.665374 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.665588 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.665677 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.665904 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.666004 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.666219 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.666317 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.666535 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.666629 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.666874 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.666971 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.667192 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.667281 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.667518 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.667606 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.667837 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.667934 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.668147 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.668235 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.668508 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.668599 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.668852 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.668959 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.669165 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.669252 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.669490 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.669613 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.669810 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.669922 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.670122 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.670226 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.670432 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.670545 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.670743 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.670838 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.671065 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.671177 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.671401 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.671526 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.671710 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.671806 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.672026 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.672115 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.672337 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.672472 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.672676 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.672766 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.672988 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.673082 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.673294 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.673381 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.673602 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.673692 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.673935 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.674031 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.674247 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.674346 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.674561 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.674650 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.674873 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.674959 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.675188 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.675284 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.675500 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.675596 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.675809 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.675905 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.676118 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.676214 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.676435 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.676526 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.676744 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.676830 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.677046 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.677150 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.677356 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.677443 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.677659 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.677748 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.677977 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.678073 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.678298 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.678394 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.678603 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.678697 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.678950 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.679078 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.679238 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.679325 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.679547 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.679676 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.679859 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.679947 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.680168 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.680256 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.680495 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.680595 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.680812 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.680912 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.681120 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.681262 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.681421 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.681508 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.681741 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.681834 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.682051 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.682139 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.682355 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.682452 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.682701 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.682789 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.683004 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.683093 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.683307 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.683426 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.683617 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.683741 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.683927 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.684015 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.684234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.684333 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.684568 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.684657 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.684878 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.684977 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.685203 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.685334 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.685515 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.685611 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.685824 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.685918 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.686156 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.686258 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.686486 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.686580 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.686788 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.686888 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.687110 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.687211 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.687435 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.687522 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.687747 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.687840 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.688048 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.688136 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.688358 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.688506 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.688690 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.688780 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.688994 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.689082 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.689294 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.689380 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.689601 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.689702 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.689903 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.689991 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.690204 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.690292 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.690505 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.690601 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.690819 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.690956 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.691105 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.691192 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.691422 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.691529 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.691730 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.691827 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.692034 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.692122 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.692336 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.692475 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.692663 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.692750 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.693003 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.693090 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.693303 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.693391 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.693641 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.693727 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.693971 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.694060 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.694288 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.694377 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.694608 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.694702 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.694915 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.695003 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.695229 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.695317 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.695537 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.695624 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.695846 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.695933 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.696155 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.696244 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.696486 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.696590 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.696805 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.696905 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.697115 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.697203 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.697432 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.697518 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.697738 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.697834 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.698582 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.698678 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.698895 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.698981 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.699210 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.699308 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.699513 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.699601 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.699826 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.699912 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.700161 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.700258 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.700515 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.700604 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.700831 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.700918 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.701151 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.701253 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.701459 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.701547 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.701772 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.701859 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.702079 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.702168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.702386 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.702481 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.702692 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.702779 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.703001 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.703089 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.703314 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.703400 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.703621 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.703716 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.703935 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.704024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.704242 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.704330 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.704585 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.704687 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.704894 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.704984 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.705209 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.705297 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.705512 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.705610 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.705822 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.705909 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.706145 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.706240 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.706475 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.706571 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.706782 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.706869 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.707092 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.707180 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.707414 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.707509 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.707724 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.707812 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.708030 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.708117 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.708339 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.708458 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.708668 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.708763 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.708969 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.709064 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.709275 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.709370 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.709587 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.709674 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.709894 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.709983 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.710202 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.710290 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.710502 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.710589 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.710814 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.710903 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.711120 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.711210 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.711418 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.711551 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.711718 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.711808 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.712028 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.712120 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.712348 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.712455 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.712683 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.712783 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.712999 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.713087 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.713317 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.713406 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.713619 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.714293 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.714461 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.714557 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.714783 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.714871 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.715090 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.715186 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.715397 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.715484 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.715696 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.715782 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.715998 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.716095 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.716340 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.716472 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.716677 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.716765 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.716983 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.717073 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.717298 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.717385 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.717619 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.717706 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.717931 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.718027 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.718241 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.718336 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.718553 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.718641 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.718863 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.718962 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.719181 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.719269 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.719491 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.719578 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.719799 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.719887 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.720107 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.720193 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.720431 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.720534 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.720746 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.720835 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.721057 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.721209 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.721379 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.721528 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.721673 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.721765 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.721986 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.722087 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.722290 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.722389 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.722591 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.722687 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.722900 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.722988 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.723216 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.723312 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.723785 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.723874 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.724116 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.724205 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.724449 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.724540 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.724772 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.724861 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.725093 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.725182 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.725411 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.725501 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.725737 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.725825 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.726064 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.726151 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.726400 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.726502 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.726702 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.726804 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.727010 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.727099 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.727315 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.727401 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.727614 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.727716 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.727927 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.728015 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.728229 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.728316 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.728557 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.728648 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.728858 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.728944 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.729168 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.729275 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.729498 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.729589 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.729802 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.729888 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.730102 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.730189 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.730404 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.730501 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.730715 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.730809 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.731016 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.731104 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.731323 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.731412 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.731625 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.731751 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.731944 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.732040 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.732248 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.732343 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.732576 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.732668 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.732880 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.732981 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.733183 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.733270 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.733523 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.733613 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.733828 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.733924 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.734160 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.734256 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.734486 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.734584 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.734826 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.734915 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.735130 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.735216 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.735433 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.735527 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.735752 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.735840 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.736056 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.736151 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.736357 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.736517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.736685 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.736781 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.736995 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.737082 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.737303 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.737389 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.737604 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.737699 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.737916 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.738005 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.738223 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.738319 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.738530 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.738617 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.738836 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.738932 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.739138 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.739234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.739446 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.739533 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.739746 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.739862 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.740055 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.740152 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.740362 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.740478 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.740687 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.740774 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.740987 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.741159 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.741296 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.741384 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.741604 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.741700 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.741904 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.742007 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.742212 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.742334 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.742512 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.742599 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.742828 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.742917 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.743127 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.743213 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.743429 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.743518 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.743728 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.743816 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.744034 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.744134 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.744340 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.744446 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.744668 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.744760 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.745529 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.745627 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.745842 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.745949 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.746147 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.746235 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.746451 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.746539 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.746757 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.746852 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.747059 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.747145 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.747359 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.747453 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.747668 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.747764 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.747986 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.748073 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.748300 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.748449 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.748627 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.748729 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.748938 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.749025 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.749237 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.749326 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.749540 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.749629 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.749840 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.749927 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.750147 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.750233 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.750445 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.750533 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.750744 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.750830 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.751041 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.751130 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.751342 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.751430 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.751641 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.751730 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.751961 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.752047 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.752268 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.752356 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.752597 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.752694 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.752898 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.752998 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.753197 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.753286 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.753537 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.753627 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.753840 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.753935 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.754194 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.754292 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.754498 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.754587 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.754808 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.754904 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.755125 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.755211 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.755435 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.755521 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.755747 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.755846 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.756060 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.756148 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.756362 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.756491 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.756696 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.756795 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.757007 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.757101 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.757567 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.757660 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.757867 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.757957 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.758169 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.758268 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.758485 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.758573 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.758794 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.758883 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.759102 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.759190 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.759420 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.759508 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.759735 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.759823 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.760054 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.760141 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.760354 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.760461 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.761232 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.761329 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.761547 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.761674 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.761860 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.761958 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.762162 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.762258 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.762469 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.762603 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.762779 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.762876 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.763087 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.763182 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.763396 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.763482 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.763702 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.763798 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.764011 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.764105 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.764311 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.764451 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.764644 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.764747 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.764953 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.765045 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.765254 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.765340 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.765573 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.765662 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.765881 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.765971 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.766182 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.766269 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.766485 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.766581 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.766786 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.766874 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.767091 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.767177 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.767391 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.767479 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.767820 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.767909 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.768132 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.768220 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.768467 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.768560 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.768768 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.768856 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.769076 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.769175 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.769384 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.769471 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.769691 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.769778 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.770001 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.770101 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.770300 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.770388 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.770711 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.770808 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.771019 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.771190 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.771328 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.771424 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.771638 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.771766 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.771940 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.772038 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.772242 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.772332 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.772576 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.772721 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.772899 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.772988 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.773202 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.773297 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.773501 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.773588 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.773805 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.773900 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.774191 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.774288 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.774428 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.774516 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.774748 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.774835 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.775161 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.775257 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.775478 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.775610 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.775780 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.775879 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.776222 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.776321 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.776563 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.776673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.776879 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.776975 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.777205 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.777301 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.777532 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.777636 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.777858 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.777954 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.778163 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.778290 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.778480 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.778575 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.778795 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.778934 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.779129 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.779222 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.779438 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.779540 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.779745 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.779841 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.780061 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.780158 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.780366 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.780520 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.780711 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.780808 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.781036 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.781129 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.781346 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.781434 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.781665 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.781768 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.782079 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.782193 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.782401 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.782500 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.782717 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.782830 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.783037 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.783127 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.783359 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.783457 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.783662 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.783754 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.783966 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.784055 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.784272 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.784361 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.784591 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.784684 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.784896 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.784985 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.785215 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.785326 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.785517 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.785614 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.785824 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.785912 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.786198 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.786311 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.786437 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.786537 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.786738 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.786834 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.787040 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.787140 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.787361 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.787451 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.787662 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.787758 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.787979 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.788076 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.788291 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.788379 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.788634 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.788727 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.788944 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.789034 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.789522 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.789657 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.789657 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.789916 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.790053 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.790143 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.790226 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.790307 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.790436 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.790535 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.790735 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.790833 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.791075 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.791164 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.791379 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.791518 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.791697 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.791813 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.792067 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.792156 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.792454 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.792561 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.792731 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.792824 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.793073 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.793164 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.793404 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.793504 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.793727 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.793816 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.794042 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.794130 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.794366 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.794469 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.794670 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.794759 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.794971 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.795059 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.795283 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.795390 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.795585 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.795672 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.795886 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.795973 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.796189 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.796279 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.796522 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.796626 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.796828 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.796923 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.797129 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.797226 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.797432 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.797615 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.797752 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.797948 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.798046 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.798259 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.798370 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.798586 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.798675 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.798901 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.799001 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.799210 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.799299 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.799518 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.799616 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.799825 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.799916 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.800170 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.800258 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.800499 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.800590 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.800834 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.800924 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.801148 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.801238 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.801473 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.801571 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.801787 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.801883 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.802102 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.802189 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.802415 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.802504 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.802730 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.802821 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.803048 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.803146 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.803362 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.803461 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.803674 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.803763 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.803985 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.804072 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.804297 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.804396 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.804637 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.804726 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.804959 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.805200 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.805530 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.805636 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.805846 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.805936 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.806158 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.806255 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.806472 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.806577 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.806786 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.806887 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.807097 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.807190 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.807944 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.808044 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.808258 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.808349 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.808595 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.808701 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.808914 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.809013 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.809244 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.809335 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.809565 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.809655 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.809887 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.809976 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.810214 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.810304 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.810531 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.810628 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.810845 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.810982 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.811158 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.811306 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.811471 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.811663 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.811830 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.811922 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.812144 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.812310 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.812514 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.812615 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.812785 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.812887 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.813099 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.813189 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.813412 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.813503 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.813722 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.813811 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.814032 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.814130 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.814342 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.814432 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.814652 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.814753 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.814963 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.815062 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.815270 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.815369 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.815580 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.815678 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.815891 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.815997 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.816204 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.816299 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.816556 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.816650 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.816892 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.816992 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.817205 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.817306 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.817517 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.817606 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.817829 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.817918 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.818147 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.818366 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.818678 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.818775 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.818998 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.819088 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.819325 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.819413 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.819646 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.819741 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.819963 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.820053 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.820280 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.820369 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.820621 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.820720 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.820946 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.821058 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.821228 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.821326 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.821534 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.821631 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.821839 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.821934 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.822140 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.822236 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.822447 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.822577 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.822757 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.822856 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.823155 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.823817 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.823982 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.824127 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.824306 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.824490 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.824644 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.824925 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.825182 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.825274 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.825536 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.825625 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.825856 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.825945 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.826185 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.826283 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.826510 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.826608 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.826820 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.826910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.827131 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.827265 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.827439 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.827536 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.827746 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.827845 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.828051 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.828139 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.828358 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.828470 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.828690 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.828799 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.828995 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.829082 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.829300 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.829389 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.829611 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.829709 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.829917 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.830007 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.830220 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.830309 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.830522 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.830619 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.830825 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.830914 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.831137 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.831232 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.831441 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.831532 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.831745 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.831834 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.832051 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.832142 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.832368 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.832552 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.832678 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.832781 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.832981 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.833093 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.833285 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.833404 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.833596 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.833709 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.833899 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.834029 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.834207 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.834333 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.834511 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.834645 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.834820 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.834952 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.835122 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.835263 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.835432 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.835568 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.835737 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.835882 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.836059 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.836188 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.836364 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.836539 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.836737 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.836839 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.837058 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.837185 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.837372 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.837504 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.837692 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.837818 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.838004 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.838142 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.838316 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.838456 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.838683 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.838817 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.839009 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.839168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.839488 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.839575 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.839857 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.840023 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.840178 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.840358 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.840540 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.840703 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.840872 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.841037 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.841179 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.841372 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.841470 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.841681 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.841856 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.841989 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.842079 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.842296 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.842392 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.842623 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.842720 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.842936 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.843025 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.843249 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.843339 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.843558 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.843656 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.843865 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.843963 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.844175 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.844262 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.844509 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.844613 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.844824 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.844915 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.845135 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.845231 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.845445 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.845586 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.845754 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.845903 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.846063 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.846217 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.846371 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.846532 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.846683 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.846844 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.847020 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.847160 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.847358 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.847478 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.847656 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.847819 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.847970 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.848143 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.848284 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.848490 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.848618 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.848810 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.848933 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.849131 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.849241 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.849444 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.849540 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.849755 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.849861 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.850064 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.850154 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.850373 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.850462 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.850690 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.850793 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.851106 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.851197 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.851423 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.851514 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.851731 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.851823 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.852073 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.852161 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.852385 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.852510 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.852729 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.852821 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.853051 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.853139 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.853362 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.853451 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.853713 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.853819 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.854024 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.854122 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.854363 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.854471 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.854689 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.854779 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.855002 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.855091 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.855326 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.855424 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.855632 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.855721 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.855937 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.856035 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.856237 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.856337 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.856572 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.856663 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.856888 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.856985 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.857193 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.857285 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.857495 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.857583 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.857796 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.857892 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.858104 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.858202 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.858404 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.858493 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.858706 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.858801 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.859012 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.859102 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.859313 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.859403 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.859616 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.859711 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.859912 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.860008 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.860212 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.860302 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.860537 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.860644 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.860839 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.860927 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.861138 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.861233 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.861438 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.861535 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.861739 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.861826 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.862037 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.862124 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.862338 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.862435 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.862639 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.862735 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.862941 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.863037 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.863239 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.863340 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.863540 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.863675 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.863844 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.863933 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.864151 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.864242 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.864511 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.864614 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.864825 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.864914 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.865144 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.865234 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.865452 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.865541 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.865766 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.865855 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.866083 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.866174 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.866393 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.866491 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.866702 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.866792 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.867024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.867120 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.867331 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.867418 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.867639 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.867747 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.867947 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.868036 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.868257 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.868345 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.868593 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.868704 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.868909 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.868999 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.869219 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.869305 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.869534 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.869645 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.869838 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.870511 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.870690 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.870778 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.871007 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.871098 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.871314 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.871409 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.871630 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.871731 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.871941 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.872032 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.872258 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.872345 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.872594 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.872683 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.872906 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.872995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.873215 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.873303 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.873527 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.873626 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.873837 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.873934 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.874148 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.874238 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.874458 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.874556 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.874767 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.874856 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.875079 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.875166 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.875387 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.875489 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.875698 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.875787 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.876015 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.876106 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.876324 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.876461 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.876672 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.876760 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.876996 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.877084 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.877307 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.877396 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.877632 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.877721 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.877962 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.878060 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.878285 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.878375 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.878596 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.878685 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.878906 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.878996 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.879209 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.879298 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.879456 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:39:19.879554 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.879852 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.880158 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:39:19.880436 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:39:20.034034 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO dbcounter [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Registered counter for database nova_api Aug 24 16:39:20.034809 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO dbcounter [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] Registered counter for database nova_api Aug 24 16:39:20.055060 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_db.sqlalchemy.engines [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:39:20.056456 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG oslo_db.sqlalchemy.engines [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:39:20.062524 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writer thread running {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:39:20.063732 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG dbcounter [-] [112673] Writer thread running {{(pid=112673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:39:20.118798 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.context [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4623f5b3-2ee5-42d8-a47e-5245b061e1ac(cell1) {{(pid=112674) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 16:39:20.121484 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.context [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4623f5b3-2ee5-42d8-a47e-5245b061e1ac(cell1) {{(pid=112673) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 16:39:20.123346 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:20.123817 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:20.125352 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG oslo_concurrency.lockutils [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:20.125457 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:20.125823 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG oslo_concurrency.lockutils [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:20.126125 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:20.126566 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:20.127389 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG oslo_concurrency.lockutils [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:20.128121 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG oslo_concurrency.lockutils [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:20.128587 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:20.128698 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG oslo_concurrency.lockutils [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:20.130558 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO dbcounter [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Registered counter for database nova_cell0 Aug 24 16:39:20.130659 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG oslo_concurrency.lockutils [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:20.132846 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO dbcounter [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] Registered counter for database nova_cell0 Aug 24 16:39:20.136347 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO dbcounter [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Registered counter for database nova_cell1 Aug 24 16:39:20.138336 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO dbcounter [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] Registered counter for database nova_cell1 Aug 24 16:39:20.143974 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_db.sqlalchemy.engines [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:39:20.146244 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_db.sqlalchemy.engines [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:39:20.148553 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG oslo_db.sqlalchemy.engines [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:39:20.149078 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG oslo_db.sqlalchemy.engines [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:39:20.151457 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writer thread running {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:39:20.155682 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG dbcounter [-] [112673] Writer thread running {{(pid=112673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:39:20.157226 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG dbcounter [-] [112673] Writer thread running {{(pid=112673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:39:20.288199 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writer thread running {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:39:20.298827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO dbcounter [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Registered counter for database nova_cell0 Aug 24 16:39:20.303314 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO dbcounter [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] Registered counter for database nova_cell0 Aug 24 16:39:20.306175 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_db.sqlalchemy.engines [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:39:20.311257 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writer thread running {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:39:20.312694 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG oslo_db.sqlalchemy.engines [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:39:20.317032 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG dbcounter [-] [112673] Writer thread running {{(pid=112673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:39:20.761654 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: WARNING keystonemiddleware.auth_token [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:39:20.769048 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: WARNING keystonemiddleware.auth_token [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:39:20.792892 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: WARNING keystonemiddleware.auth_token [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:39:20.800231 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: WARNING keystonemiddleware.auth_token [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:39:21.110507 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: WARNING keystonemiddleware.auth_token [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:39:21.116537 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: WARNING keystonemiddleware.auth_token [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:39:21.121823 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637a0a3c9c0 pid: 112674 (default app) Aug 24 16:39:21.123953 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:21.125141 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001812 Aug 24 16:39:21.125544 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Wed Aug 24 16:39:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:21.141955 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: WARNING keystonemiddleware.auth_token [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:39:21.148037 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: WARNING keystonemiddleware.auth_token [None req-ccf7977e-c28a-49f0-a530-b84ab220c856 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:39:21.153943 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637a0a3c9c0 pid: 112673 (default app) Aug 24 16:40:43.558557 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:43.560146 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002050 Aug 24 16:40:43.560770 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 2/2] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:40:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:43.573042 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG dbcounter [-] [112673] Writing DB stats nova_api:SELECT=3 {{(pid=112673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:43.573993 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG dbcounter [-] [112673] Writing DB stats nova_cell0:SELECT=3 {{(pid=112673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:43.575276 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG dbcounter [-] [112673] Writing DB stats nova_cell1:SELECT=3 {{(pid=112673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:43.576692 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG dbcounter [-] [112673] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:44.558946 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-755854b6-cceb-4874-b112-32042face4b3 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:44.591806 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-755854b6-cceb-4874-b112-32042face4b3 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.023876 Aug 24 16:40:44.593455 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 1/3] 10.222.0.70 () {60 vars in 1292 bytes} [Wed Aug 24 16:40:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:47.008940 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:47.009946 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-3ac871d1-62e9-4f06-aaa5-ae438a72f3c6 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 24 16:40:47.010273 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 3/4] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:40:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:47.459000 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-068be514-31c3-4a2f-8290-481be2dc6953 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1}} {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:47.478316 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:40:47.478316 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: warnings.warn(msg) Aug 24 16:40:47.593822 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-068be514-31c3-4a2f-8290-481be2dc6953 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.575885 Aug 24 16:40:47.594955 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 2/5] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Aug 24 16:40:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:40:47.614096 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writing DB stats nova_api:SELECT=3 {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:47.615009 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writing DB stats nova_cell1:SELECT=3 {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:47.616074 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writing DB stats nova_cell0:SELECT=3 {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:47.617256 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:47.827931 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-2f44ebb5-b8e1-426f-9674-16e3e739cbb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:47.832200 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:40:47.832200 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: warnings.warn(msg) Aug 24 16:40:47.961779 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-2f44ebb5-b8e1-426f-9674-16e3e739cbb8 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.353724 Aug 24 16:40:47.962372 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 4/6] 10.222.0.70 () {64 vars in 1336 bytes} [Wed Aug 24 16:40:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:50.319894 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-068be514-31c3-4a2f-8290-481be2dc6953 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:50.320946 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-068be514-31c3-4a2f-8290-481be2dc6953 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 24 16:40:50.322077 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 3/7] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:40:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:50.996568 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-b528f4a8-d0a1-4441-b775-15f7467f6965 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:51.015859 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:40:51.015859 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: warnings.warn(msg) Aug 24 16:40:51.097958 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-b528f4a8-d0a1-4441-b775-15f7467f6965 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.769614 Aug 24 16:40:51.098756 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 5/8] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Aug 24 16:40:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:40:51.111245 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-a485a426-e18d-4a4e-99f4-fb8b78434a96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:51.114077 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:40:51.114077 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: warnings.warn(msg) Aug 24 16:40:51.243868 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-a485a426-e18d-4a4e-99f4-fb8b78434a96 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136237 Aug 24 16:40:51.244735 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 4/9] 10.222.0.70 () {64 vars in 1336 bytes} [Wed Aug 24 16:40:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:53.595436 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-b528f4a8-d0a1-4441-b775-15f7467f6965 admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:53.596477 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-b528f4a8-d0a1-4441-b775-15f7467f6965 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 24 16:40:53.596887 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 6/10] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:40:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:54.000638 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-a682c37d-f6ab-4e1e-872a-8cb4ddd4269b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:54.063307 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-a682c37d-f6ab-4e1e-872a-8cb4ddd4269b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459982 Aug 24 16:40:54.063924 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 5/11] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Aug 24 16:40:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:40:54.076556 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-8a58660e-9f1e-44d2-8b6b-076e8d45eee2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:54.164084 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-8a58660e-9f1e-44d2-8b6b-076e8d45eee2 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091171 Aug 24 16:40:54.165254 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 7/12] 10.222.0.70 () {64 vars in 1336 bytes} [Wed Aug 24 16:40:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:56.556030 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-a682c37d-f6ab-4e1e-872a-8cb4ddd4269b admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:56.557084 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-a682c37d-f6ab-4e1e-872a-8cb4ddd4269b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002019 Aug 24 16:40:56.557474 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 6/13] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:56.991424 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-a9aec513-bb80-4aab-b3f5-d5353edd6a05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:57.068691 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-a9aec513-bb80-4aab-b3f5-d5353edd6a05 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505109 Aug 24 16:40:57.069251 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 8/14] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Aug 24 16:40:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:40:57.081604 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-cc7c9839-24f5-4be5-bdd3-047bf689debc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:57.175530 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-cc7c9839-24f5-4be5-bdd3-047bf689debc admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097416 Aug 24 16:40:57.176461 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 7/15] 10.222.0.70 () {64 vars in 1336 bytes} [Wed Aug 24 16:40:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:59.548684 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-a9aec513-bb80-4aab-b3f5-d5353edd6a05 admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:59.549856 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-a9aec513-bb80-4aab-b3f5-d5353edd6a05 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Aug 24 16:40:59.550520 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 9/16] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:40:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:00.001040 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-bebbea47-14b2-4c22-b851-d393ca9438a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096}} {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:00.073062 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-bebbea47-14b2-4c22-b851-d393ca9438a4 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.515598 Aug 24 16:41:00.074052 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 8/17] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Aug 24 16:40:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:41:00.086241 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-0322703b-4225-42ca-b166-5f558c01ae2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:00.161930 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-0322703b-4225-42ca-b166-5f558c01ae2f admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079306 Aug 24 16:41:00.162633 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 10/18] 10.222.0.70 () {64 vars in 1336 bytes} [Wed Aug 24 16:41:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:02.894062 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-bebbea47-14b2-4c22-b851-d393ca9438a4 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:02.895507 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-bebbea47-14b2-4c22-b851-d393ca9438a4 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001746 Aug 24 16:41:02.896195 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 9/19] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:41:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:03.334717 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-2028b4e5-8d93-4d44-b716-2c9a9e06c8e8 admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:03.361687 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-2028b4e5-8d93-4d44-b716-2c9a9e06c8e8 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.456084 Aug 24 16:41:03.362244 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 11/20] 10.222.0.70 () {60 vars in 1292 bytes} [Wed Aug 24 16:41:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:05.739003 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-bebbea47-14b2-4c22-b851-d393ca9438a4 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:05.740138 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-bebbea47-14b2-4c22-b851-d393ca9438a4 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001723 Aug 24 16:41:05.740660 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 10/21] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:41:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:06.201001 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-981baa94-9cd4-4de1-b9d1-7a93f4216e1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "disk": 1, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:06.399645 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-981baa94-9cd4-4de1-b9d1-7a93f4216e1c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.634310 Aug 24 16:41:06.399645 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 12/22] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Aug 24 16:41:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:41:06.399967 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-3eb44e55-28e3-43e9-9b2e-b63b34cd668b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:06.551671 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-3eb44e55-28e3-43e9-9b2e-b63b34cd668b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160651 Aug 24 16:41:06.557176 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 11/23] 10.222.0.70 () {64 vars in 1333 bytes} [Wed Aug 24 16:41:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:08.900504 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-981baa94-9cd4-4de1-b9d1-7a93f4216e1c admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:08.901508 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-981baa94-9cd4-4de1-b9d1-7a93f4216e1c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 24 16:41:08.901905 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 13/24] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:41:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:09.281535 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-33414cd2-1646-4428-9dad-4cfafb3864cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "disk": 20, "os-flavor-access:is_public": true}} {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:09.359924 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-33414cd2-1646-4428-9dad-4cfafb3864cf admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.451518 Aug 24 16:41:09.360519 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 12/25] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Aug 24 16:41:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:41:09.373439 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-9578424f-5f58-40e4-b6bc-25e2652dd0c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:09.454354 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-9578424f-5f58-40e4-b6bc-25e2652dd0c3 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084617 Aug 24 16:41:09.454925 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 14/26] 10.222.0.70 () {64 vars in 1333 bytes} [Wed Aug 24 16:41:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:11.873075 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-33414cd2-1646-4428-9dad-4cfafb3864cf admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:11.875814 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-33414cd2-1646-4428-9dad-4cfafb3864cf admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001869 Aug 24 16:41:11.876221 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 13/27] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:41:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:12.328163 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-5dd32c4d-dc25-4dd0-a422-d2bdbf9b1a29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "vcpus": 2, "disk": 40}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:12.409209 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-5dd32c4d-dc25-4dd0-a422-d2bdbf9b1a29 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.525749 Aug 24 16:41:12.410056 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 15/28] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Aug 24 16:41:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:41:12.423258 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-88dc50b9-f0f8-4da7-9025-77c2a485e96d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:12.516287 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-88dc50b9-f0f8-4da7-9025-77c2a485e96d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096714 Aug 24 16:41:12.516898 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 14/29] 10.222.0.70 () {64 vars in 1333 bytes} [Wed Aug 24 16:41:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:14.927500 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-5dd32c4d-dc25-4dd0-a422-d2bdbf9b1a29 admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:14.928553 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-5dd32c4d-dc25-4dd0-a422-d2bdbf9b1a29 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 24 16:41:14.929248 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 16/30] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:41:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:15.422379 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-fe5b2284-a59c-43bd-8653-db9a3c596cbd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4}} {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:15.430515 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG dbcounter [-] [112673] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:15.856205 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-fe5b2284-a59c-43bd-8653-db9a3c596cbd admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.920959 Aug 24 16:41:15.856785 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 15/31] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Aug 24 16:41:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:41:15.869919 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-1a78cadd-fd02-4526-a449-c6a031873885 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:15.986366 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-1a78cadd-fd02-4526-a449-c6a031873885 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120648 Aug 24 16:41:15.987665 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 17/32] 10.222.0.70 () {64 vars in 1333 bytes} [Wed Aug 24 16:41:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:18.441131 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-fe5b2284-a59c-43bd-8653-db9a3c596cbd admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:18.442895 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-fe5b2284-a59c-43bd-8653-db9a3c596cbd admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002239 Aug 24 16:41:18.444739 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 16/33] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:18.915840 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-cd2e4184-689a-41d8-b00f-0c4b7db470dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "disk": 160, "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:18.924333 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:18.983228 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-cd2e4184-689a-41d8-b00f-0c4b7db470dd admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.528886 Aug 24 16:41:18.984302 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 18/34] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Aug 24 16:41:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:41:18.997331 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-8d3c0cf7-819c-4bb1-b8b2-8789d609abb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:19.106452 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-8d3c0cf7-819c-4bb1-b8b2-8789d609abb0 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113120 Aug 24 16:41:19.107036 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 17/35] 10.222.0.70 () {64 vars in 1333 bytes} [Wed Aug 24 16:41:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:37.413409 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-cd2e4184-689a-41d8-b00f-0c4b7db470dd admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:37.414429 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-cd2e4184-689a-41d8-b00f-0c4b7db470dd admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Aug 24 16:41:37.414837 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 19/36] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:41:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:37.812639 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-18b3a739-7180-46ee-ac68-6900361d8842 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:37.830418 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-18b3a739-7180-46ee-ac68-6900361d8842 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409419 Aug 24 16:41:37.830942 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 18/37] 10.222.0.70 () {60 vars in 1292 bytes} [Wed Aug 24 16:41:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:38.900108 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-cd2e4184-689a-41d8-b00f-0c4b7db470dd admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:38.901224 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-cd2e4184-689a-41d8-b00f-0c4b7db470dd admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Aug 24 16:41:38.901635 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 20/38] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Aug 24 16:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:39.427062 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-5c31d475-4bb9-4b13-9659-f798b9ad661a admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:39.432954 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.wsgi [None req-5c31d475-4bb9-4b13-9659-f798b9ad661a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-5c31d475-4bb9-4b13-9659-f798b9ad661a admin admin] Request method failure captured: Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Accept: application/json Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Accept-Encoding: gzip, deflate Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Connection: keep-alive Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Content-Length: 0 Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Host: 10.222.0.70 Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Openstack-Api-Version: compute 2.90 Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Openstack-System-Scope: None Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: User-Agent: python-novaclient Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Auth-Token: gAAAAABjBlTCZg6od05uPJ42X6u4-lFYWv8NIv5XnBkAfTxXS0r79x8BSQ9QTdLdUvN5b_i3Ul5mxi_6gc8C2j8TYs7aC9gA9qcYepIjwpFmuwqRc7ExMrolgqbhEC3yVJMjLx5f2eG2K5QRy8zTTwq14yMBz_8tqdzZvFFJpF5TfpqflazL0uQ Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Domain-Id: None Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Domain-Name: None Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Identity-Status: Confirmed Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Is-Admin-Project: True Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Project-Domain-Id: default Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Project-Domain-Name: Default Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Project-Id: 8f3b91fa60b4447a866a572209ebc37f Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Project-Name: admin Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Role: reader,member,admin Aug 24 16:41:39.436262 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Roles: reader,member,admin Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Tenant: admin Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Tenant-Id: 8f3b91fa60b4447a866a572209ebc37f Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Tenant-Name: admin Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User: admin Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User-Domain-Id: default Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User-Domain-Name: Default Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User-Id: cffc436199314734957ccd7232ed1e29 Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User-Name: admin Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: method: > Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: exception: Flavor 42 could not be found. Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: action_args: {'id': '42'} Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:41:39.438024 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:39.438910 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:39.440184 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-5c31d475-4bb9-4b13-9659-f798b9ad661a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:41:39.441387 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-5c31d475-4bb9-4b13-9659-f798b9ad661a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397090 Aug 24 16:41:39.441387 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 19/39] 10.222.0.70 () {60 vars in 1190 bytes} [Wed Aug 24 16:41:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:39.447793 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-0ac71fa7-4c8f-4dad-9e44-1e9b369d33ca admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:39.470865 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-0ac71fa7-4c8f-4dad-9e44-1e9b369d33ca admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026912 Aug 24 16:41:39.471437 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 21/40] 10.222.0.70 () {60 vars in 1210 bytes} [Wed Aug 24 16:41:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:39.482219 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-0482a8df-ec64-4b6c-ac12-4bf45a9a0edc admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:39.506655 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-0482a8df-ec64-4b6c-ac12-4bf45a9a0edc admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028092 Aug 24 16:41:39.512578 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 20/41] 10.222.0.70 () {60 vars in 1210 bytes} [Wed Aug 24 16:41:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:41:39.521283 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-fbdf075c-d786-4e23-a20b-26bd9e285dde admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:39.528068 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.wsgi [None req-fbdf075c-d786-4e23-a20b-26bd9e285dde admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-fbdf075c-d786-4e23-a20b-26bd9e285dde admin admin] Request method failure captured: Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Accept: application/json Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Accept-Encoding: gzip, deflate Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Connection: keep-alive Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Content-Length: 0 Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Host: 10.222.0.70 Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Openstack-Api-Version: compute 2.90 Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Openstack-System-Scope: None Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: User-Agent: python-novaclient Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Auth-Token: gAAAAABjBlTCZg6od05uPJ42X6u4-lFYWv8NIv5XnBkAfTxXS0r79x8BSQ9QTdLdUvN5b_i3Ul5mxi_6gc8C2j8TYs7aC9gA9qcYepIjwpFmuwqRc7ExMrolgqbhEC3yVJMjLx5f2eG2K5QRy8zTTwq14yMBz_8tqdzZvFFJpF5TfpqflazL0uQ Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Domain-Id: None Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Domain-Name: None Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Identity-Status: Confirmed Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Is-Admin-Project: True Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Project-Domain-Id: default Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Project-Domain-Name: Default Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Project-Id: 8f3b91fa60b4447a866a572209ebc37f Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Project-Name: admin Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Role: reader,member,admin Aug 24 16:41:39.531397 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Roles: reader,member,admin Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Tenant: admin Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Tenant-Id: 8f3b91fa60b4447a866a572209ebc37f Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Tenant-Name: admin Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User: admin Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User-Domain-Id: default Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User-Domain-Name: Default Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User-Id: cffc436199314734957ccd7232ed1e29 Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User-Name: admin Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: method: > Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: exception: Flavor 42 could not be found. Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: action_args: {'id': '42'} Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:41:39.532995 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:39.534031 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:39.535517 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-fbdf075c-d786-4e23-a20b-26bd9e285dde admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:41:39.536835 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-fbdf075c-d786-4e23-a20b-26bd9e285dde admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015534 Aug 24 16:41:39.536835 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 22/42] 10.222.0.70 () {60 vars in 1190 bytes} [Wed Aug 24 16:41:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:40.506058 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-0482a8df-ec64-4b6c-ac12-4bf45a9a0edc admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:40.507598 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-0482a8df-ec64-4b6c-ac12-4bf45a9a0edc admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Aug 24 16:41:40.507989 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 21/43] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Aug 24 16:41:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:41.039953 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-d2eda0ff-3d3d-4e9c-8389-6a7032563abe admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:41.045231 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.wsgi [None req-d2eda0ff-3d3d-4e9c-8389-6a7032563abe admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-d2eda0ff-3d3d-4e9c-8389-6a7032563abe admin admin] Request method failure captured: Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Accept: application/json Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Accept-Encoding: gzip, deflate Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Connection: keep-alive Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Content-Length: 0 Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Host: 10.222.0.70 Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Openstack-Api-Version: compute 2.90 Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Openstack-System-Scope: None Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: User-Agent: python-novaclient Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Auth-Token: gAAAAABjBlTE12Bi--kS0CsEbUUyr5uxTQ9BUxU9q0aZov1IM9m4wR90EbfO5tfKQQ_OGapZqmeAqLsSXU3FvB1PXcDoRcZnwI6_-sOW7xQZJFe6MIrO3jX_xlk7FfNZ6I4QfvTphbPOSz94lvkvE-rWj7ufcPchhwFyu_PeSafD1hEidLUn8Wc Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Domain-Id: None Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Domain-Name: None Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Identity-Status: Confirmed Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Is-Admin-Project: True Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Project-Domain-Id: default Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Project-Domain-Name: Default Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Project-Id: 8f3b91fa60b4447a866a572209ebc37f Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Project-Name: admin Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Role: reader,member,admin Aug 24 16:41:41.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Roles: reader,member,admin Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Tenant: admin Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Tenant-Id: 8f3b91fa60b4447a866a572209ebc37f Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Tenant-Name: admin Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User: admin Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User-Domain-Id: default Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User-Domain-Name: Default Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User-Id: cffc436199314734957ccd7232ed1e29 Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User-Name: admin Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: method: > Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: exception: Flavor 84 could not be found. Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: action_args: {'id': '84'} Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:41:41.048681 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:41.049673 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:41.050827 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-d2eda0ff-3d3d-4e9c-8389-6a7032563abe admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:41:41.051834 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-d2eda0ff-3d3d-4e9c-8389-6a7032563abe admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.402197 Aug 24 16:41:41.051834 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 23/44] 10.222.0.70 () {60 vars in 1190 bytes} [Wed Aug 24 16:41:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:41.058263 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-0e40d8a9-ac9f-4bf6-986a-004f238f4f75 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:41.073361 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-0e40d8a9-ac9f-4bf6-986a-004f238f4f75 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018654 Aug 24 16:41:41.073882 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 22/45] 10.222.0.70 () {60 vars in 1210 bytes} [Wed Aug 24 16:41:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:41.083478 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-edeaf05b-df42-414e-ba15-aab714b4140a admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:41.098938 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-edeaf05b-df42-414e-ba15-aab714b4140a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019243 Aug 24 16:41:41.099471 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 24/46] 10.222.0.70 () {60 vars in 1210 bytes} [Wed Aug 24 16:41:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:41.109022 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-76ede924-2eeb-471c-b945-a90990328cdf admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:41.114469 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.wsgi [None req-76ede924-2eeb-471c-b945-a90990328cdf admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-76ede924-2eeb-471c-b945-a90990328cdf admin admin] Request method failure captured: Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Accept: application/json Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Accept-Encoding: gzip, deflate Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Connection: keep-alive Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Content-Length: 0 Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Host: 10.222.0.70 Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Openstack-Api-Version: compute 2.90 Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Openstack-System-Scope: None Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: User-Agent: python-novaclient Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Auth-Token: gAAAAABjBlTE12Bi--kS0CsEbUUyr5uxTQ9BUxU9q0aZov1IM9m4wR90EbfO5tfKQQ_OGapZqmeAqLsSXU3FvB1PXcDoRcZnwI6_-sOW7xQZJFe6MIrO3jX_xlk7FfNZ6I4QfvTphbPOSz94lvkvE-rWj7ufcPchhwFyu_PeSafD1hEidLUn8Wc Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Domain-Id: None Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Domain-Name: None Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Identity-Status: Confirmed Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Is-Admin-Project: True Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Project-Domain-Id: default Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Project-Domain-Name: Default Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Project-Id: 8f3b91fa60b4447a866a572209ebc37f Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Project-Name: admin Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Role: reader,member,admin Aug 24 16:41:41.116026 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Roles: reader,member,admin Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Tenant: admin Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Tenant-Id: 8f3b91fa60b4447a866a572209ebc37f Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Tenant-Name: admin Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User: admin Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User-Domain-Id: default Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User-Domain-Name: Default Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User-Id: cffc436199314734957ccd7232ed1e29 Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User-Name: admin Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: method: > Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: exception: Flavor 84 could not be found. Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: action_args: {'id': '84'} Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:41:41.117743 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:41.118575 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:41.119642 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-76ede924-2eeb-471c-b945-a90990328cdf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:41:41.120707 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-76ede924-2eeb-471c-b945-a90990328cdf admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012100 Aug 24 16:41:41.120707 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 23/47] 10.222.0.70 () {60 vars in 1190 bytes} [Wed Aug 24 16:41:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:42.087415 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-edeaf05b-df42-414e-ba15-aab714b4140a admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:42.088454 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-edeaf05b-df42-414e-ba15-aab714b4140a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 24 16:41:42.088850 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 25/48] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Aug 24 16:41:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:42.612965 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-680fffb3-12f7-41bb-987b-35203c2da05b admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:42.618683 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.wsgi [None req-680fffb3-12f7-41bb-987b-35203c2da05b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-680fffb3-12f7-41bb-987b-35203c2da05b admin admin] Request method failure captured: Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Accept: application/json Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Accept-Encoding: gzip, deflate Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Connection: keep-alive Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Content-Length: 0 Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Host: 10.222.0.70 Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Openstack-Api-Version: compute 2.90 Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Openstack-System-Scope: None Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: User-Agent: python-novaclient Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Auth-Token: gAAAAABjBlTF2yD673-0BLGOe3mv-2bSTMKB75qfKL3GstAily7tJfraimK7YLX5JmUxZgEJyz7K9EwZ-K-INH5GvM6V_o6H6vX4Ls6aMB4nRkVtvzNMVeoPlXyV-3Ag_q-sHEHA0NJr8I0JzbiJU3bF-gJn7sb3a9FzygeQvNZBL4VK8iIm2sk Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Domain-Id: None Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Domain-Name: None Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Identity-Status: Confirmed Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Is-Admin-Project: True Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Project-Domain-Id: default Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Project-Domain-Name: Default Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Project-Id: 8f3b91fa60b4447a866a572209ebc37f Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Project-Name: admin Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Role: reader,member,admin Aug 24 16:41:42.620168 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Roles: reader,member,admin Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Tenant: admin Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Tenant-Id: 8f3b91fa60b4447a866a572209ebc37f Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-Tenant-Name: admin Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User: admin Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User-Domain-Id: default Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User-Domain-Name: Default Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User-Id: cffc436199314734957ccd7232ed1e29 Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: X-User-Name: admin Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: method: > Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: exception: Flavor 451 could not be found. Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: action_args: {'id': '451'} Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:41:42.621803 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:42.622695 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: ERROR nova.api.openstack.wsgi Aug 24 16:41:42.624005 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-680fffb3-12f7-41bb-987b-35203c2da05b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:41:42.625310 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-680fffb3-12f7-41bb-987b-35203c2da05b admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392326 Aug 24 16:41:42.625310 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 24/49] 10.222.0.70 () {60 vars in 1193 bytes} [Wed Aug 24 16:41:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:42.632769 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-6c196564-8cfd-409e-b534-0cc7324f3af7 admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:42.648019 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-6c196564-8cfd-409e-b534-0cc7324f3af7 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020281 Aug 24 16:41:42.648631 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 26/50] 10.222.0.70 () {60 vars in 1210 bytes} [Wed Aug 24 16:41:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:42.658016 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:42.673224 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018726 Aug 24 16:41:42.673762 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 25/51] 10.222.0.70 () {60 vars in 1210 bytes} [Wed Aug 24 16:41:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:42.683099 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-9c7b368d-0c0c-4a62-8b2f-33838f654827 admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:42.688474 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.wsgi [None req-9c7b368d-0c0c-4a62-8b2f-33838f654827 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-9c7b368d-0c0c-4a62-8b2f-33838f654827 admin admin] Request method failure captured: Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Accept: application/json Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Accept-Encoding: gzip, deflate Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Connection: keep-alive Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Content-Length: 0 Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Host: 10.222.0.70 Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Openstack-Api-Version: compute 2.90 Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Openstack-System-Scope: None Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: User-Agent: python-novaclient Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Auth-Token: gAAAAABjBlTF2yD673-0BLGOe3mv-2bSTMKB75qfKL3GstAily7tJfraimK7YLX5JmUxZgEJyz7K9EwZ-K-INH5GvM6V_o6H6vX4Ls6aMB4nRkVtvzNMVeoPlXyV-3Ag_q-sHEHA0NJr8I0JzbiJU3bF-gJn7sb3a9FzygeQvNZBL4VK8iIm2sk Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Domain-Id: None Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Domain-Name: None Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Identity-Status: Confirmed Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Is-Admin-Project: True Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Project-Domain-Id: default Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Project-Domain-Name: Default Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Project-Id: 8f3b91fa60b4447a866a572209ebc37f Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Project-Name: admin Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Role: reader,member,admin Aug 24 16:41:42.689956 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Roles: reader,member,admin Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8f3b91fa60b4447a866a572209ebc37f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Tenant: admin Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Tenant-Id: 8f3b91fa60b4447a866a572209ebc37f Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-Tenant-Name: admin Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User: admin Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User-Domain-Id: default Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User-Domain-Name: Default Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User-Id: cffc436199314734957ccd7232ed1e29 Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: X-User-Name: admin Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: method: > Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: exception: Flavor 451 could not be found. Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: action_args: {'id': '451'} Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:41:42.691271 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:42.692071 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: ERROR nova.api.openstack.wsgi Aug 24 16:41:42.694234 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-9c7b368d-0c0c-4a62-8b2f-33838f654827 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:41:42.695500 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-9c7b368d-0c0c-4a62-8b2f-33838f654827 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011806 Aug 24 16:41:42.695500 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 27/52] 10.222.0.70 () {60 vars in 1193 bytes} [Wed Aug 24 16:41:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:43.675156 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:43.676178 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 24 16:41:43.676600 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 26/53] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Aug 24 16:41:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:44.211461 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-b23ee14e-7b6f-4a8d-bf6b-b05eb40dccce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:44.266721 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-b23ee14e-7b6f-4a8d-bf6b-b05eb40dccce admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.446713 Aug 24 16:41:44.268458 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 28/54] 10.222.0.70 () {64 vars in 1235 bytes} [Wed Aug 24 16:41:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:41:45.249586 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:45.250614 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 24 16:41:45.251032 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 27/55] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Aug 24 16:41:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:45.800554 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-e725dcdd-06d0-4624-8880-f939c6d5fdce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:45.906996 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-e725dcdd-06d0-4624-8880-f939c6d5fdce admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.515155 Aug 24 16:41:45.907574 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 29/56] 10.222.0.70 () {64 vars in 1235 bytes} [Wed Aug 24 16:41:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:41:46.916756 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:46.917767 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 24 16:41:46.918158 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 28/57] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Aug 24 16:41:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:47.447971 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-270a4ebe-88e4-4240-a633-5e0cacf8087d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:47.546830 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-270a4ebe-88e4-4240-a633-5e0cacf8087d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.490348 Aug 24 16:41:47.547408 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 30/58] 10.222.0.70 () {64 vars in 1235 bytes} [Wed Aug 24 16:41:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:41:48.514650 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:48.515798 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 24 16:41:48.516186 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 29/59] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Aug 24 16:41:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:49.046585 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-ee791b4d-e5be-48fa-ab85-75875af6fcf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:49.111540 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-ee791b4d-e5be-48fa-ab85-75875af6fcf8 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.455917 Aug 24 16:41:49.112096 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 31/60] 10.222.0.70 () {64 vars in 1235 bytes} [Wed Aug 24 16:41:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:41:50.086772 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:50.087781 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 24 16:41:50.088179 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 30/61] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Aug 24 16:41:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:50.607978 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-7508d45b-e985-45ba-be6c-7b225ab6a26d admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:50.628426 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-7508d45b-e985-45ba-be6c-7b225ab6a26d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401747 Aug 24 16:41:50.628962 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 32/62] 10.222.0.70 () {60 vars in 1202 bytes} [Wed Aug 24 16:41:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:44.562732 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:44.564395 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-c1ad38e4-2bf7-4399-afb0-337962c48242 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002103 Aug 24 16:42:44.564821 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 31/63] 10.222.0.70 () {54 vars in 931 bytes} [Wed Aug 24 16:42:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:42:44.576444 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:44.962634 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-507d8550-cce6-444a-94f9-21d98f7afb8c admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:44.983171 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-507d8550-cce6-444a-94f9-21d98f7afb8c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411220 Aug 24 16:42:44.983710 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 33/64] 10.222.0.70 () {60 vars in 1292 bytes} [Wed Aug 24 16:42:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:45.005950 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG dbcounter [-] [112673] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:45.009709 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-cece4869-b8ba-41cb-bfa3-1f633db53106 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:45.017323 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-cece4869-b8ba-41cb-bfa3-1f633db53106 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012787 Aug 24 16:42:45.022808 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 32/65] 10.222.0.70 () {60 vars in 1283 bytes} [Wed Aug 24 16:42:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:45.029923 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-d311bfff-f25d-41f2-9edd-033de078b6d2 admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:45.038379 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-d311bfff-f25d-41f2-9edd-033de078b6d2 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012113 Aug 24 16:42:45.038970 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 34/66] 10.222.0.70 () {60 vars in 1286 bytes} [Wed Aug 24 16:42:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:45.052316 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-682d89be-e56e-4ade-a976-b3903a5cc944 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:45.060082 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-682d89be-e56e-4ade-a976-b3903a5cc944 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012331 Aug 24 16:42:45.060648 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 33/67] 10.222.0.70 () {60 vars in 1286 bytes} [Wed Aug 24 16:42:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:45.072668 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-613bafec-60c5-4122-ad3e-4952d6b138f6 admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:45.080630 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-613bafec-60c5-4122-ad3e-4952d6b138f6 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011613 Aug 24 16:42:45.081155 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 35/68] 10.222.0.70 () {60 vars in 1283 bytes} [Wed Aug 24 16:42:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:55.852145 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-682d89be-e56e-4ade-a976-b3903a5cc944 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:55.853234 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-682d89be-e56e-4ade-a976-b3903a5cc944 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 24 16:45:55.853633 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 34/69] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Aug 24 16:45:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:45:55.995669 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writing DB stats nova_api:SELECT=6 {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:56.157813 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-a3307a66-a6d9-44d4-99e9-19ed84a7b4ac admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:56.160180 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:45:56.160180 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: warnings.warn(msg) Aug 24 16:45:56.161467 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-a3307a66-a6d9-44d4-99e9-19ed84a7b4ac admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:56.161934 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-a3307a66-a6d9-44d4-99e9-19ed84a7b4ac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:56.162349 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-a3307a66-a6d9-44d4-99e9-19ed84a7b4ac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:56.163042 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-a3307a66-a6d9-44d4-99e9-19ed84a7b4ac admin admin] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:56.163471 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-a3307a66-a6d9-44d4-99e9-19ed84a7b4ac admin admin] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:56.163875 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-a3307a66-a6d9-44d4-99e9-19ed84a7b4ac admin admin] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:56.198583 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-a3307a66-a6d9-44d4-99e9-19ed84a7b4ac admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204280 Aug 24 16:45:56.199142 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 36/70] 10.222.0.70 () {60 vars in 1193 bytes} [Wed Aug 24 16:45:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:45:57.029458 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-682d89be-e56e-4ade-a976-b3903a5cc944 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:57.031017 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-682d89be-e56e-4ade-a976-b3903a5cc944 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 24 16:45:57.031408 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 35/71] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Aug 24 16:45:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:45:57.223862 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-78308218-35ec-4ac2-80c0-6d04bd1469e2 admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:57.226254 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:45:57.226254 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: warnings.warn(msg) Aug 24 16:45:57.227334 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-78308218-35ec-4ac2-80c0-6d04bd1469e2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:57.227798 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-78308218-35ec-4ac2-80c0-6d04bd1469e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:57.228241 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-78308218-35ec-4ac2-80c0-6d04bd1469e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:57.228960 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-78308218-35ec-4ac2-80c0-6d04bd1469e2 admin admin] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:57.229398 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-78308218-35ec-4ac2-80c0-6d04bd1469e2 admin admin] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:57.229802 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-78308218-35ec-4ac2-80c0-6d04bd1469e2 admin admin] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:57.248950 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-78308218-35ec-4ac2-80c0-6d04bd1469e2 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078454 Aug 24 16:45:57.250005 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 37/72] 10.222.0.70 () {60 vars in 1193 bytes} [Wed Aug 24 16:45:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:46:08.494580 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-682d89be-e56e-4ade-a976-b3903a5cc944 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:08.494580 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-682d89be-e56e-4ade-a976-b3903a5cc944 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 24 16:46:08.494580 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 36/73] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Aug 24 16:46:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:08.623899 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writing DB stats nova_cell0:SELECT=4 {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:08.624645 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writing DB stats nova_cell1:SELECT=4 {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:08.625259 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG dbcounter [-] [112674] Writing DB stats nova_api:SELECT=8 {{(pid=112674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:08.674350 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-d8a14c82-71be-4813-9f13-4574367b04ef admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:08.676739 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:46:08.676739 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: warnings.warn(msg) Aug 24 16:46:08.677842 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-d8a14c82-71be-4813-9f13-4574367b04ef admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.678331 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-d8a14c82-71be-4813-9f13-4574367b04ef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.678742 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-d8a14c82-71be-4813-9f13-4574367b04ef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.679449 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-d8a14c82-71be-4813-9f13-4574367b04ef admin admin] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.679889 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-d8a14c82-71be-4813-9f13-4574367b04ef admin admin] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.680301 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-d8a14c82-71be-4813-9f13-4574367b04ef admin admin] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.726266 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-d8a14c82-71be-4813-9f13-4574367b04ef admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.106900 Aug 24 16:46:08.726757 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 38/74] 10.222.0.70 () {60 vars in 1193 bytes} [Wed Aug 24 16:46:08 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:46:09.570415 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: DEBUG nova.api.openstack.wsgi [None req-682d89be-e56e-4ade-a976-b3903a5cc944 admin admin] Calling method '>' {{(pid=112673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:09.572300 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: INFO nova.api.openstack.requestlog [None req-682d89be-e56e-4ade-a976-b3903a5cc944 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 24 16:46:09.578248 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: [pid: 112673|app: 0|req: 37/75] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Aug 24 16:46:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:09.764679 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG nova.api.openstack.wsgi [None req-c223c6a9-c1b0-4b52-a3fa-f5a2f20c1419 admin admin] Calling method '>' {{(pid=112674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:09.767339 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:46:09.767339 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: warnings.warn(msg) Aug 24 16:46:09.768548 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-c223c6a9-c1b0-4b52-a3fa-f5a2f20c1419 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:09.768959 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-c223c6a9-c1b0-4b52-a3fa-f5a2f20c1419 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:09.769380 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-c223c6a9-c1b0-4b52-a3fa-f5a2f20c1419 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:09.770080 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-c223c6a9-c1b0-4b52-a3fa-f5a2f20c1419 admin admin] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:09.770516 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-c223c6a9-c1b0-4b52-a3fa-f5a2f20c1419 admin admin] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:09.770926 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: DEBUG oslo_concurrency.lockutils [None req-c223c6a9-c1b0-4b52-a3fa-f5a2f20c1419 admin admin] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:09.792635 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: INFO nova.api.openstack.requestlog [None req-c223c6a9-c1b0-4b52-a3fa-f5a2f20c1419 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080060 Aug 24 16:46:09.793190 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: [pid: 112674|app: 0|req: 39/76] 10.222.0.70 () {60 vars in 1193 bytes} [Wed Aug 24 16:46:09 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:47:10.495838 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: Wed Aug 24 16:47:10 2022 - graceful shutdown triggered... Aug 24 16:47:10.495584 dv-cinder-852208-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 16:47:10.497107 dv-cinder-852208-9-iscsi devstack@n-api.service[112673]: Gracefully killing worker 1 (pid: 112673)... Aug 24 16:47:10.497482 dv-cinder-852208-9-iscsi devstack@n-api.service[112674]: Gracefully killing worker 2 (pid: 112674)... Aug 24 16:47:11.496535 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: worker 1 buried after 1 seconds Aug 24 16:47:11.497113 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: worker 2 buried after 1 seconds Aug 24 16:47:11.497113 dv-cinder-852208-9-iscsi devstack@n-api.service[112672]: goodbye to uWSGI. Aug 24 16:47:11.498095 dv-cinder-852208-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 16:47:11.498645 dv-cinder-852208-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 16:47:11.501500 dv-cinder-852208-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 16:47:11.510940 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 16:47:11.513631 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 16:47:11 2022] *** Aug 24 16:47:11.513631 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 16:47:11.513631 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 16:47:11.513631 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: nodename: dv-cinder-852208-9-iscsi Aug 24 16:47:11.513631 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: machine: x86_64 Aug 24 16:47:11.513631 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: clock source: unix Aug 24 16:47:11.513631 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: pcre jit disabled Aug 24 16:47:11.513631 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: detected number of CPU cores: 4 Aug 24 16:47:11.513631 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: current working directory: / Aug 24 16:47:11.513631 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: detected binary path: /usr/bin/uwsgi-core Aug 24 16:47:11.514279 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: your processes number limit is 47680 Aug 24 16:47:11.514279 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: your memory page size is 4096 bytes Aug 24 16:47:11.514279 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: detected max file descriptor number: 2048 Aug 24 16:47:11.514279 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: lock engine: pthread robust mutexes Aug 24 16:47:11.514279 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: thunder lock: enabled Aug 24 16:47:11.514279 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 16:47:11.514279 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 16:47:11.553502 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: Python main interpreter initialized at 0x56084034e9c0 Aug 24 16:47:11.553502 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: python threads support enabled Aug 24 16:47:11.553502 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: your server socket listen backlog is limited to 100 connections Aug 24 16:47:11.553502 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: your mercy for graceful operations on workers is 90 seconds Aug 24 16:47:11.553878 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 16:47:11.553963 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: *** Operational MODE: preforking *** Aug 24 16:47:11.554209 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: *** uWSGI is running in multiple interpreter mode *** Aug 24 16:47:11.554209 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: spawned uWSGI master process (pid: 127697) Aug 24 16:47:11.554400 dv-cinder-852208-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 16:47:11.565477 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: spawned uWSGI worker 1 (pid: 127715, cores: 1) Aug 24 16:47:11.565477 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: spawned uWSGI worker 2 (pid: 127716, cores: 1) Aug 24 16:47:11.565477 dv-cinder-852208-9-iscsi devstack@n-api.service[127697]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 16:47:12.226751 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 16:47:12.238248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 16:47:13.380725 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:47:13.380725 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: from cryptography.utils import int_from_bytes Aug 24 16:47:13.381405 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:47:13.381405 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: from cryptography.utils import int_from_bytes Aug 24 16:47:13.421240 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:47:13.421240 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: from cryptography.utils import int_from_bytes Aug 24 16:47:13.421806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:47:13.421806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: from cryptography.utils import int_from_bytes Aug 24 16:47:15.790863 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:47:15.791484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:47:15.791672 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:47:15.792047 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:47:15.792359 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:47:15.792740 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.793113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.793441 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.793780 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.794273 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.794598 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.794935 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.795273 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.795616 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.795887 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.796394 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-9-iscsi {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.802951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.803399 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.803399 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.803399 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.803399 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.803399 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.803399 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-9-iscsi {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.803399 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.806264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.806264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.806264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.806264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.806264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.806264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.806264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.806264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.806823 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.806823 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.807843 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.809321 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.809699 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.810150 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.811099 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.811542 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.811938 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.812331 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.812683 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.813071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.813484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.813964 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.814367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.814694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.815015 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.815438 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.815832 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.816246 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.816670 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.817050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.817572 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.818107 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.818490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.818870 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.819357 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.819742 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.820530 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.821157 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.821569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.821967 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.822452 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.822765 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.823147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.823593 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.823985 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.825019 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.830777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.830777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.830777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.830777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.830777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.830777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.830777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.830777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.831498 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:47:15.831924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.832042 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:47:15.832145 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.832145 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.832311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:47:15.832444 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.832547 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:47:15.832650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.832762 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:47:15.832762 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.832762 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.833011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.833104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.833189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.833288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.833383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.833469 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.833561 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.833657 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.833754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.833850 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.833850 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.834419 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.834511 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.834605 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.834703 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.834703 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.834887 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.834984 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-9-iscsi {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.834984 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.835140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.835239 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.835333 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.835433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.835433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.835433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.835695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.835794 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.835794 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.835950 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.836209 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.836328 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.837209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.837322 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.837425 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.837521 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.837616 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.837719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.837823 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.838312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.838429 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.838525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.838618 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.838836 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.839098 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.839203 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.839468 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.839705 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.839900 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-9-iscsi {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.840273 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.840382 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.840589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.840764 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.840868 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.841254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.841355 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.841568 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.841824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.841919 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.842209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.842435 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.842532 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.842812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.843001 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.843213 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.843465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.843558 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.843786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.844025 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.844128 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.844419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.844637 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.844732 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.845029 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.845178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.845351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.845658 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.845758 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.845964 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.846216 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.846340 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.846525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.846857 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.846975 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.847161 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.847318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.847490 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.847838 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.848129 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.848271 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.848429 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.848795 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.848946 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.848946 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.849121 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.849256 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.849689 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.849962 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.850068 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.850164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.850281 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.850447 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.850666 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.850784 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.851054 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.851206 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.851346 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.851660 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.851767 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.851985 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.852258 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.852351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.852634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.852854 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.853039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.853271 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.853410 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.853562 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.853796 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.853937 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.854596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.854757 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.854924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.854924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.855409 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.855516 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.855695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.855784 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.855784 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.855955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.856050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.856328 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.856458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.862088 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.862251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.862430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.862579 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.862733 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.862892 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.863046 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.863463 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.863607 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.864273 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.864467 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.864623 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.864860 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.865005 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.865147 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.865299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.865460 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.865613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.865765 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.865904 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.866044 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.866203 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.866359 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.866359 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.866577 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.866664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.866749 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.866843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.866950 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.867266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.867410 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.867543 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.867647 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.867745 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.867840 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.867935 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.868029 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.868116 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.868210 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.868325 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.868325 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.868532 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.868735 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.868735 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.869171 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.869263 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.869357 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.869458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.869590 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.869700 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.869700 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.869862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.869963 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.870682 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.870794 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.870794 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.871823 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.871920 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.871920 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.872095 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.872182 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.872182 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.872182 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.872465 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.872568 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.872568 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.872747 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.872899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.872899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.872899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.873154 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.873249 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.873249 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.873249 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.873483 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.873568 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.873568 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.873748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.873844 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.873944 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.874031 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.874031 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.874193 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.874288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.874288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.874288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.874288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:47:15.874597 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.874683 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.874683 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.874683 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.874683 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.874683 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.875095 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.875189 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.875289 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.875586 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.875705 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.876027 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.876165 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.876361 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.876691 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.876789 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.877018 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.877346 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.877502 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.877640 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.877812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.877961 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.878297 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.878389 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.878617 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.878855 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.878978 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.879306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.879400 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.879544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.879862 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.879972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.880256 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.880436 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.880548 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.880849 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.880981 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.881194 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.881465 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.881567 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.884422 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.885123 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.885280 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.885381 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.885490 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.885578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.885664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.885756 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.885853 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.885940 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.886032 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.886117 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.886202 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.886432 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.886523 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.887204 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.887759 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.887759 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.887943 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.888047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.888135 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.888220 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.888220 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.888220 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.900375 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.900545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.900545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.900545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.900822 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.900914 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.901000 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.901174 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.901271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.901365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.901365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.901529 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.901626 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.901720 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.901814 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.901901 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.901985 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.902071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.902197 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.902289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.902374 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.902467 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.902553 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.902815 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.902929 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.903019 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.903106 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.903191 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.903284 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.903378 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.903474 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.903569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.903671 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.903765 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.903852 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.903947 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.904035 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.904121 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.904206 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.904297 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.904386 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.904503 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.904592 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.904693 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.904779 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.904872 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.904959 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.906057 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.906184 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.906283 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.906370 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.906457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.906554 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.906673 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.906948 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.907046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.907133 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.907219 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.907315 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.907403 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.907488 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.907595 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.907697 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.908067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.908175 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.908356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.908490 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.908582 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.908669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.908762 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.908902 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.909040 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.909149 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.909245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.909333 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.909823 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.910007 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.910135 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.910229 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.910316 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.910410 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.910507 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.910595 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.910680 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.910800 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.910899 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.910994 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.911090 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.911186 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.911186 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.911186 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.911186 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.911186 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.911579 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.911699 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.911699 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.911699 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.911937 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.912067 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.912067 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.912067 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.912067 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.912444 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.912544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.912544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.912544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.912544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.912877 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.912970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.913056 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.913151 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.913238 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.913323 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.913323 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.913493 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.913579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.913579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.913579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.913579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.913889 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.913975 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.914227 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.914341 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.914341 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.914341 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.914578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.914664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.914664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.914664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.914664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.914664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915045 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.915808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.921358 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.921644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.921644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.921644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.921644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.921644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.921644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.922590 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.922689 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.922689 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.922847 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.922944 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.923032 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.923118 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.923211 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.923298 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.923390 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.924363 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.924509 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.925332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.925475 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.925609 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.925719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.925809 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.925905 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.926001 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.926095 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.926191 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.926293 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.926425 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.926562 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.926660 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.926747 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.926841 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.926938 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.927040 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.927127 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.927220 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.927306 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.927392 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.927487 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.927612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.927612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.927612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.927900 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.928100 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.928203 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.928300 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.928300 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.928300 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.929688 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.929838 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.929938 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.930026 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.930110 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.930251 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.930375 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.930515 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.930628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.930724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.930819 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.930917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.930917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.930917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.931260 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.931365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.931365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.931365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.931664 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.931812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.931812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.931812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.931812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.932138 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.932238 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.932238 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.933169 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.933281 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.933385 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.934050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.934161 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.934250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.934250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.934250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.936839 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.936934 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.936934 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.936934 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.937170 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.937273 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.937273 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.937273 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.937273 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.937598 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.937684 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.937777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.937871 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.937972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.939403 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.939403 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.939403 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.939661 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.939757 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.939858 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.939956 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.940044 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.940044 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.940199 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.940332 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.940541 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.940689 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.940786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.940786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.940786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.940786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.941103 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.941201 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.941201 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.941201 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.941434 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.941529 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.941623 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.941716 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.941809 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.941909 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.941909 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.942141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.942253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.942253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.942427 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.942521 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.942521 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.942521 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.942521 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.943292 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.943383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.943383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.943383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.943383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.943383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.943719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.943801 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.943885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.943967 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.943967 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.944097 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.944308 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.944667 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.944963 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.945152 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.945311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.945621 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.945730 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.945967 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.946239 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.946347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.946633 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.946821 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.946965 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.947236 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.947774 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.947897 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.948039 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.948130 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.948130 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.948514 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.948623 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.949070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.949722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.949816 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.950069 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.950313 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.950453 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.950682 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.951224 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.951348 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.951439 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.951533 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.951628 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.951881 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.951982 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.952186 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.952516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.952630 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.952832 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.953232 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.953350 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.953455 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.953696 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.953798 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.954030 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.954301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.954406 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.954681 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.954885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.954980 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.955289 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.955470 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.955581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.955885 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.956051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.956190 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.956526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.956640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.956856 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.957141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.957235 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.957466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.957719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.957813 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.958065 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.958306 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.958659 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.958659 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.958852 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.958961 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.959317 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.959454 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.959587 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.959854 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.959955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.960176 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.960504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.960607 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.961219 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.961219 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.961405 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.961552 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.961684 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.961993 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.962085 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.962298 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.962567 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.962671 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.962893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.963209 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.963343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.963612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.963759 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.963946 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.964111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.964767 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.964879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.965011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.965117 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.965117 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.965383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.965542 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.965680 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.966039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.966144 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.966350 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.966624 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.966726 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.966978 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.967199 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.967293 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.967591 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.967761 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.967907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.968213 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.968314 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.968592 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.968835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.968933 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.969427 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.969543 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.969640 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.969758 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.969939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.970111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.970414 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.970566 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.970699 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.971013 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.971108 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.971337 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.971579 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.971683 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.971958 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.972144 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.972262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.972595 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.972738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.972910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.973319 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.973436 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.973541 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.973843 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.973975 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.974122 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.974359 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.974454 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.974736 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.974931 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.975048 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.975357 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.975495 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.975669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.976331 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.976509 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.976603 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.976698 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.976787 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.976934 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.977146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.977250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.977543 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.977712 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.977849 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.978163 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.978275 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.978494 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.978814 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.978920 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.980349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.980515 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.980674 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.980780 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.980884 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.980980 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.981519 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.981622 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.981725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.981725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.981725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.981981 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.982116 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.982221 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.982311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.982311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.982491 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.982578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.982817 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.982968 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.983127 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.983274 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.983586 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.983685 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.983937 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.984178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.984281 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.984531 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.984812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.984917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.985151 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.985339 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.985457 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.985782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.985882 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.986202 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.986393 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.986516 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.986823 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.986979 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.987238 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.987467 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.987576 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.987848 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.988045 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.988175 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.988530 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.988626 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.988861 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.989137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.989249 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.989515 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.989835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.989944 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.990088 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.990289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.990417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.990732 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.990840 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.991049 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.991340 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.991435 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.991670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.991906 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.992000 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.992291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.992495 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.992639 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.992988 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.993091 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.993364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.993618 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.993736 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.994620 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.994731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.994831 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.994919 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.995013 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.995013 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.995187 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.995276 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.995480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.996677 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.996804 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.996906 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.997105 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.997249 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.997497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.998991 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.999128 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.999231 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.999332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.999421 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.999508 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.999625 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:15.999714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.000158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.000272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.000272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.000272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.000537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.000674 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.000831 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.000929 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.000929 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.000929 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.001177 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.001325 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.001472 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.001806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.001909 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.002082 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.002384 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.002487 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.002732 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.002957 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.003051 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.003353 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.003528 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.003808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.004172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.004281 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.004371 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.004621 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.004717 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.004986 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.005188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.005293 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.005612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.005842 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.005938 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.006232 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.006409 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.006540 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.006853 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.006946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.007160 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.007433 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.007527 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.007760 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.007941 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.008068 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.008732 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.008847 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.008847 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.009211 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.009589 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.009703 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.010308 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.010434 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.010546 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.010729 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.010729 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.011028 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.011129 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.011264 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.011401 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.011631 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.012474 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.012586 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.012788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.012965 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.013146 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.013439 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.013535 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.013797 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.013939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.014078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.014369 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.014494 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.014681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.014780 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.015004 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.015116 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.015323 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.015442 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.015641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.015742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.015956 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.016049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.016273 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.016414 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.016615 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.016710 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.016936 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.017092 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.017245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.022840 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.022951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.023050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.023139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.023225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.023312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.023408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.023496 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.023590 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.023678 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.023764 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.023850 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.023966 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.024064 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.024148 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.024232 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.024328 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.024464 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.024545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.024618 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.024618 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.024807 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.024807 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.024954 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.025049 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.025151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.025245 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.025341 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.025341 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.025515 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.025603 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.025688 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.025783 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.025878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.025974 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.026070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.026158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.026243 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.026336 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.026430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.026531 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.026626 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.026711 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.026711 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.026887 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.026982 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.027083 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.027191 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.027291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.027379 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.027466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.027562 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.027657 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.027752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.027839 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.027931 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.028018 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.028130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.028220 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.028314 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.028429 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.028429 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.028604 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.028707 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.028824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.028912 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.028998 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.029084 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.029180 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.029292 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.029381 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.029381 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.029547 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.029642 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.029740 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.029837 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.029919 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.030009 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.030097 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.030191 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.030288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.030288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.030430 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.030509 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.030590 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.030758 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.030941 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.031132 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.031278 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.031433 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.031579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.031807 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.031955 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.032101 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.032192 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.032325 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.032576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.032686 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.032837 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.032935 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.033155 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.033249 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.033459 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.033575 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.033778 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.033863 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.034141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.034233 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.034460 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.034564 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.034769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.034862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.035098 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.035250 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.035415 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.035562 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.035725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.035871 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.036049 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.036192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.036364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.036628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.037013 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.037327 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.037640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.038149 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.038487 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.038815 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.039096 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.039227 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.039437 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.039547 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.039744 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.039852 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.040096 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.040207 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.040635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.040940 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.041271 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.041382 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.041702 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.041825 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.041924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.042023 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.042239 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.042398 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.042567 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.042731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.043424 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.043587 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.043744 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.043915 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.044057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.044245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.044375 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.044579 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.044725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.044888 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.045038 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.045201 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.045354 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.045511 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.045664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.045818 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.045995 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.046143 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.046307 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.046448 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.046616 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.046760 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.046952 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.047068 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.047309 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.047416 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.047621 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.047718 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.047932 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.048028 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.048240 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.048347 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.048565 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.048670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.048892 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.049080 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.049193 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.049283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.049517 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.049614 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.049829 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.049942 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.050134 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.050229 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.050440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.050538 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.050754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.050887 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.051059 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.051236 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.051381 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.051485 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.051687 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.051813 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.052012 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.052126 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.052319 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.052446 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.052660 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.052762 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.052984 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.053078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.053296 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.053396 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.053606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.053709 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.053937 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.054044 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.054267 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.054369 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.054587 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.054805 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.054900 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.055145 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.055248 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.055468 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.055571 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.055790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.055883 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.056100 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.056202 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.056465 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.056567 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.056744 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.056855 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.057050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.057161 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.057358 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.057481 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.057658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.057755 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.057960 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.058055 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.058263 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.058361 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.059133 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.059226 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.059447 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.059543 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.059761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.059909 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.060076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.060171 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.060383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.060517 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.060708 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.060826 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.061015 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.061147 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.061327 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.061461 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.061636 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.061733 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.061948 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.062053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.062256 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.062361 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.062570 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.062666 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.062882 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.062985 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.063194 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.063291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.063508 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.063612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.063821 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.063959 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.064130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.064219 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.064450 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.064578 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.064764 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.064879 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.065069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.065165 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.065378 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.065481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.065690 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.065784 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.066008 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.066113 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.066321 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.066564 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.066668 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.066892 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.067037 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.067205 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.067348 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.067518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.067668 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.067831 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.068036 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.068146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.068296 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.068463 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.068647 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.068780 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.068972 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.069077 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.069284 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.069389 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.069606 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.069710 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.069919 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.070015 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.070251 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.070347 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.070592 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.070696 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.070924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.071037 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.071239 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.071375 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.071543 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.071660 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.071842 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.071953 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.072149 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.072256 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.072489 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.072590 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.072811 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.072907 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.073115 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.073222 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.073419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.073513 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.073728 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.073831 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.074052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.074153 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.074366 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.074468 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.074672 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.074775 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.074975 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.075083 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.075279 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.075384 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.075583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.075678 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.075881 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.075984 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.076186 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.076295 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.076524 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.076632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.076833 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.076929 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.077136 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.077238 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.077443 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.077593 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.077744 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.077846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.078049 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.078164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.078353 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.078460 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.078656 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.078865 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.078960 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.079179 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.079275 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.079510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.079608 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.079835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.079937 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.080161 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.080330 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.080497 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.080609 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.080816 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.080918 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.081141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.081269 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.081450 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.081533 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.081753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.081858 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.082059 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.082171 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.082368 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.082473 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.082668 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.082771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.082989 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.083109 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.083298 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.083395 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.083601 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.083698 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.083910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.084013 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.084221 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.084323 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.084557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.084869 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.085196 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.085400 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.085526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.085760 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.085856 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.086084 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.086194 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.086419 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.086515 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.086752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.086847 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.087065 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.087161 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.087376 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.087468 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.087705 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.087823 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.088010 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.088116 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.088316 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.088444 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.088650 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.088755 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.088963 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.089078 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.089265 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.089357 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.089571 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.089687 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.089969 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.090078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.090283 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.090387 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.090590 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.090695 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.090903 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.090994 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.091209 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.091317 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.091541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.091701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.091927 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.092066 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.092242 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.092391 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.092509 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.092612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.092752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.092848 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.093058 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.093154 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.093361 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.093539 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.093664 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.093783 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.093963 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.094100 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.094272 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.094411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.094574 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.094718 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.094881 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.094976 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:47:16.095183 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.095490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.095791 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.096097 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.096419 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.096747 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.097053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.097404 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.097732 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.098093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.098415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.098725 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.099033 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.099377 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.099695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.100229 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.100594 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.100910 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.101250 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.101576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.101910 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.102217 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.102518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.102839 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.103150 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.103459 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.103768 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.104077 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.104386 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.104715 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.105030 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.105891 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.106202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.106511 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.106820 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.107128 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.107435 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.107744 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.108055 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.108392 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.108731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.109043 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.109357 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.109671 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.109981 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.110290 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.110598 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.110903 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.111220 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.112120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.112120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.112120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.112590 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.114578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.114578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.114578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.114578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.114578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.114578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.115112 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.115112 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.115306 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.115632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.115969 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.116295 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.116650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.116955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.117257 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.117560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.117867 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.118180 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.118486 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.118788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.119086 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.119393 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.119695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.119996 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.120295 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.120634 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.121943 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.122168 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.122471 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.122773 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.123074 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.123375 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.123675 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.123981 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.124282 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.124610 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.124915 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.125218 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.125519 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.125850 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.127069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.127069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.127069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.127350 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.127476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.127846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.128109 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.128444 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.128763 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.129073 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.129404 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.129714 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.130025 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.130366 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.130677 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.130987 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.131296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.131647 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.132045 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.132289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.132634 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.132952 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.133269 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.133582 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.133892 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.134217 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.134525 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.134834 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.135140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.135448 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.135754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.136064 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.136370 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.136731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.137046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.137362 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.137684 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.138008 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.138314 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.138637 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.138960 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.139306 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.139614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.139955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.140280 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.140612 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.143161 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.143161 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:47:16.143161 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:47:16.157406 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO dbcounter [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] Registered counter for database nova_api Aug 24 16:47:16.178902 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_db.sqlalchemy.engines [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:47:16.186016 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writer thread running {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:47:16.203150 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO dbcounter [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] Registered counter for database nova_api Aug 24 16:47:16.223012 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:47:16.229601 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writer thread running {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:47:16.241672 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.context [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4623f5b3-2ee5-42d8-a47e-5245b061e1ac(cell1) {{(pid=127715) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 16:47:16.245752 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:16.247052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:16.248646 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:16.249403 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:16.249856 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:16.251830 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:16.253852 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO dbcounter [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] Registered counter for database nova_cell0 Aug 24 16:47:16.257875 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO dbcounter [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] Registered counter for database nova_cell1 Aug 24 16:47:16.265104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_db.sqlalchemy.engines [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:47:16.266835 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_db.sqlalchemy.engines [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:47:16.272847 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writer thread running {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:47:16.274985 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writer thread running {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:47:16.285839 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.context [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4623f5b3-2ee5-42d8-a47e-5245b061e1ac(cell1) {{(pid=127716) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 16:47:16.289980 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:16.290453 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:16.292028 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:16.293332 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:16.293781 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:16.295736 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:16.297734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO dbcounter [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] Registered counter for database nova_cell0 Aug 24 16:47:16.301676 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO dbcounter [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] Registered counter for database nova_cell1 Aug 24 16:47:16.309074 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:47:16.310761 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:47:16.316224 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writer thread running {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:47:16.321537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writer thread running {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:47:16.422306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO dbcounter [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] Registered counter for database nova_cell0 Aug 24 16:47:16.428916 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_db.sqlalchemy.engines [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:47:16.433271 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writer thread running {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:47:16.466712 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO dbcounter [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] Registered counter for database nova_cell0 Aug 24 16:47:16.473223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:47:16.477620 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writer thread running {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:47:16.750316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: WARNING keystonemiddleware.auth_token [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:47:16.757506 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: WARNING keystonemiddleware.auth_token [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:47:16.792223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: WARNING keystonemiddleware.auth_token [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:47:16.800217 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: WARNING keystonemiddleware.auth_token [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:47:17.101366 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: WARNING keystonemiddleware.auth_token [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:47:17.107933 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: WARNING keystonemiddleware.auth_token [None req-c93a2f47-349d-4be6-968e-199a54ab3ca4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:47:17.113285 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56084034e9c0 pid: 127715 (default app) Aug 24 16:47:17.146407 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: WARNING keystonemiddleware.auth_token [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:47:17.152928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: WARNING keystonemiddleware.auth_token [None req-e7ff6ccd-8dd2-4cd4-84f4-35960ec2a39d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:47:17.158195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56084034e9c0 pid: 127716 (default app) Aug 24 16:47:53.819733 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:53.820580 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:53.821361 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:53.822087 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:54.946256 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d50a430b-f2fd-4fee-b499-71dd8d7efcb6 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] Action: 'create', calling method: .version_select at 0x7fa1969f68b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1481813", "metadata": {"Type": "work"}}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:57.469299 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d50a430b-f2fd-4fee-b499-71dd8d7efcb6 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 350 microversion: 2.1 time: 3.653975 Aug 24 16:47:57.469299 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 1/1] 10.222.0.70 () {60 vars in 1156 bytes} [Wed Aug 24 16:47:53 2022] POST /compute/v2.1/os-volumes => generated 350 bytes in 3656 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 16:47:57.889432 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cefcddab-0589-4d59-8beb-2bdcd09400f7 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] Calling method '.version_select at 0x7fa196aab430>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:57.920802 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=3 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:57.921582 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=3 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:57.922416 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=3 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:57.923642 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=3 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:58.399300 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cefcddab-0589-4d59-8beb-2bdcd09400f7 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/0d7f16b2-85fa-42bf-9b33-db958e4f5ffb" status: 200 len: 350 microversion: 2.1 time: 0.914247 Aug 24 16:47:58.400464 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1/2] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 16:47:57 2022] GET /compute/v2.1/os-volumes/0d7f16b2-85fa-42bf-9b33-db958e4f5ffb => generated 350 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:59.414043 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-da3135c0-f9bd-404c-bbe7-a365e5c65319 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] Calling method '.version_select at 0x7fa19684b700>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:59.500668 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-da3135c0-f9bd-404c-bbe7-a365e5c65319 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/0d7f16b2-85fa-42bf-9b33-db958e4f5ffb" status: 200 len: 351 microversion: 2.1 time: 0.090867 Aug 24 16:47:59.501436 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 16:47:59 2022] GET /compute/v2.1/os-volumes/0d7f16b2-85fa-42bf-9b33-db958e4f5ffb => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:59.517769 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-233fa3a4-5dd9-483d-b9de-4ee7dcdba5b2 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] Calling method '.version_select at 0x7fa196887940>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:59.579250 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-233fa3a4-5dd9-483d-b9de-4ee7dcdba5b2 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/0d7f16b2-85fa-42bf-9b33-db958e4f5ffb" status: 200 len: 351 microversion: 2.1 time: 0.068773 Aug 24 16:47:59.580354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 16:47:59 2022] GET /compute/v2.1/os-volumes/0d7f16b2-85fa-42bf-9b33-db958e4f5ffb => generated 351 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:59.598431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b133ef00-4618-4131-b4ff-127bba459dd6 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] Calling method '.version_select at 0x7fa19684bdc0>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:59.938308 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b133ef00-4618-4131-b4ff-127bba459dd6 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/0d7f16b2-85fa-42bf-9b33-db958e4f5ffb" status: 202 len: 0 microversion: 2.1 time: 0.343941 Aug 24 16:47:59.942103 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 3/5] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Aug 24 16:47:59 2022] DELETE /compute/v2.1/os-volumes/0d7f16b2-85fa-42bf-9b33-db958e4f5ffb => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:47:59.962427 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5d3a25fd-2db3-4703-831c-b873f930408e tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] Calling method '.version_select at 0x7fa196887e50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:00.431984 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5d3a25fd-2db3-4703-831c-b873f930408e tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/0d7f16b2-85fa-42bf-9b33-db958e4f5ffb" status: 200 len: 350 microversion: 2.1 time: 0.488145 Aug 24 16:48:00.434563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 3/6] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 16:47:59 2022] GET /compute/v2.1/os-volumes/0d7f16b2-85fa-42bf-9b33-db958e4f5ffb => generated 350 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:01.450213 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8f21665a-7bf0-4fed-8e91-b87c198ae649 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] Calling method '.version_select at 0x7fa1968624c0>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:01.566603 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-8f21665a-7bf0-4fed-8e91-b87c198ae649 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] HTTP exception thrown: Volume 0d7f16b2-85fa-42bf-9b33-db958e4f5ffb could not be found. Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8f21665a-7bf0-4fed-8e91-b87c198ae649 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] Request method failure captured: Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/os-volumes/0d7f16b2-85fa-42bf-9b33-db958e4f5ffb HTTP/1.1 Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlY5BiMlaNSH1mqP2sZ1N3OcJy_mE1_1xQ150r1JTYksP-4H8UlXqVaGXCv3_8CoLZh9xbOrxy37N0QbBhrYklrSK_8jbnyC6mI0XeE3XOOFO4P04TkwfDB-0IcDIyd_fq0Lkp14C5TB0QWqRpjK2T93tzZBEmf03weqgsP7NJAVVJo Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: ae344977452b43acb4a5f6b1e4aafbbd Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-VolumesGetTestJSON-266333741 Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:48:01.570899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:48:01.572302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ae344977452b43acb4a5f6b1e4aafbbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ae344977452b43acb4a5f6b1e4aafbbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ae344977452b43acb4a5f6b1e4aafbbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ae344977452b43acb4a5f6b1e4aafbbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:48:01.572302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-VolumesGetTestJSON-266333741 Aug 24 16:48:01.572302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: ae344977452b43acb4a5f6b1e4aafbbd Aug 24 16:48:01.572302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-VolumesGetTestJSON-266333741 Aug 24 16:48:01.572302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-VolumesGetTestJSON-266333741-project Aug 24 16:48:01.572302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:48:01.572302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:48:01.572302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 0e61fef0f7d2437eb97b796ee86cdc5c Aug 24 16:48:01.572302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-VolumesGetTestJSON-266333741-project Aug 24 16:48:01.572302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: Aug 24 16:48:01.572302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Volume 0d7f16b2-85fa-42bf-9b33-db958e4f5ffb could not be found. Aug 24 16:48:01.572302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '0d7f16b2-85fa-42bf-9b33-db958e4f5ffb'} Aug 24 16:48:01.572302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d7f16b2-85fa-42bf-9b33-db958e4f5ffb could not be found. (HTTP 404) (Request-ID: req-34bb33dd-c973-4643-997c-f960c1d7c061) Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:48:01.573910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:48:01.575433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d7f16b2-85fa-42bf-9b33-db958e4f5ffb could not be found. Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 16:48:01.576634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:48:01.577795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d7f16b2-85fa-42bf-9b33-db958e4f5ffb could not be found. Aug 24 16:48:01.577795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:48:01.577795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:48:01.577795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:48:01.577795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:48:01.577795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:48:01.577795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:48:01.577795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:48:01.577795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:48:01.577795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d7f16b2-85fa-42bf-9b33-db958e4f5ffb could not be found. Aug 24 16:48:01.577795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:48:01.580201 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8f21665a-7bf0-4fed-8e91-b87c198ae649 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] Returning 404 to user: Volume 0d7f16b2-85fa-42bf-9b33-db958e4f5ffb could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:48:01.581324 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8f21665a-7bf0-4fed-8e91-b87c198ae649 tempest-VolumesGetTestJSON-266333741 tempest-VolumesGetTestJSON-266333741-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/0d7f16b2-85fa-42bf-9b33-db958e4f5ffb" status: 404 len: 109 microversion: 2.1 time: 0.137966 Aug 24 16:48:01.581903 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 16:48:01 2022] GET /compute/v2.1/os-volumes/0d7f16b2-85fa-42bf-9b33-db958e4f5ffb => generated 109 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:48:05.988065 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-382388292", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "networks": [{"uuid": "04842728-aff1-4b1b-b91a-5e83e9aaeae5"}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:06.229330 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] validate_networks() for [('04842728-aff1-4b1b-b91a-5e83e9aaeae5', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:48:08.287281 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:48:08.291181 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:48:08.291181 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:48:08.291181 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:48:08.291181 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:48:08.317974 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:08.323202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:08.323202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:08.323202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:08.323202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:08.323520 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:08.400583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Getting quotas for project 3b5a3a82d90e4811a3037a8cda927913. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:48:08.421641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Getting quotas for user e2257adc34324452a325bb7786d02515 and project 3b5a3a82d90e4811a3037a8cda927913. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:48:08.455669 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:48:08.460092 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:48:08.721274 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-10f1ea64-1dfa-4851-8132-3bfee9355f0e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.061293 Aug 24 16:48:08.728107 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 4/8] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:48:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:48:08.734795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fdfc098c-c5f7-4588-b792-c682b0650462 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:08.736766 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fdfc098c-c5f7-4588-b792-c682b0650462 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:09.068948 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fdfc098c-c5f7-4588-b792-c682b0650462 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:09.090905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fdfc098c-c5f7-4588-b792-c682b0650462 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1214 microversion: 2.1 time: 0.359904 Aug 24 16:48:09.093036 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 5/9] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:08 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1214 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:09.367695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-32414700-3a22-47cf-a584-1f6649c7f2c6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Action: 'create', calling method: .version_select at 0x7fa195f69160>, body: {"keypair": {"name": "tempest-keypair-1429959760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNelX2PWk7F+MCQdvqovHx4ijMAxXXzioCPo3fB7oea3Xd+R+oLFYw9ny1DB4TX+5hCeSHXOASA2PHo1+zNld4nzOXnHjCHTDT7AZDjCelmbcxJ3+AXbixQODtWP5EARfQ=="}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:09.422179 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-32414700-3a22-47cf-a584-1f6649c7f2c6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Getting quotas for project 525245253a2d49c48ef009a4d6c3cd51. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:48:09.438690 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-32414700-3a22-47cf-a584-1f6649c7f2c6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Getting quotas for user 7a930257a6584b04bae278aa83940264 and project 525245253a2d49c48ef009a4d6c3cd51. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:48:09.550675 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-97413475", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:09.686480 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-32414700-3a22-47cf-a584-1f6649c7f2c6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.776209 Aug 24 16:48:09.691522 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 5/10] 10.222.0.70 () {62 vars in 1200 bytes} [Wed Aug 24 16:48:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 784 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 16:48:09.872474 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.network.neutron [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] validate_networks() for [('ce570f83-6f1d-44d5-bf3a-fed77a6a5242', None, None, None, None, None)] {{(pid=127715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:48:10.124632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0f7171e5-ce14-4bff-8ce7-052ca9669e6b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:10.125681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0f7171e5-ce14-4bff-8ce7-052ca9669e6b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:10.432809 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0f7171e5-ce14-4bff-8ce7-052ca9669e6b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:10.466994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0f7171e5-ce14-4bff-8ce7-052ca9669e6b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1214 microversion: 2.1 time: 0.358294 Aug 24 16:48:10.467662 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 6/11] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:10 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1214 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:11.430685 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6fc94efb-35af-441a-8487-28fed17a8c13 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Action: 'create', calling method: .version_select at 0x7fa195718af0>, body: {"keypair": {"name": "tempest-keypair-1152618529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLS69JuDrw7FrjdFW5sn9Fs88HvFWycZaaOCXhbwnxHqWftcqWKCQbZBcIoIlXz9VUuptXuWrNC26LrxT1UWuCVcTuzLEh7MTWN5uR7jFOSZGrho+BR0H3MA4huqERTvXA=="}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:11.455289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-6fc94efb-35af-441a-8487-28fed17a8c13 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for project 6b5b284e0b47422592057492601db382. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:48:11.473241 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-6fc94efb-35af-441a-8487-28fed17a8c13 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for user 88efd5eb09064aa2aa89e6d9580c6476 and project 6b5b284e0b47422592057492601db382. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:48:11.618784 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6fc94efb-35af-441a-8487-28fed17a8c13 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.054171 Aug 24 16:48:11.621642 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 7/12] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Aug 24 16:48:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:11.626700 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-52b9b703-2abf-46f6-8bb2-d44af7048042 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:11.627624 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-52b9b703-2abf-46f6-8bb2-d44af7048042 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:11.941301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-52b9b703-2abf-46f6-8bb2-d44af7048042 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:11.952779 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-52b9b703-2abf-46f6-8bb2-d44af7048042 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1214 microversion: 2.1 time: 0.329816 Aug 24 16:48:11.962053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 8/13] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:11 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1214 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:12.437047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Flavor limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:48:12.438230 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Image limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:48:12.438867 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Flavor pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:48:12.439422 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Image pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:48:12.440002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:48:12.472019 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:12.472544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:12.472993 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:12.473725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:12.474182 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:12.474606 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:12.570459 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Getting quotas for project 42f5635b43e74a96a56d56cccbc111b5. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:48:12.585805 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Getting quotas for user 45913fc3d9ba42ea9e971db25e656c61 and project 42f5635b43e74a96a56d56cccbc111b5. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:48:12.600098 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Going to run 1 instances... {{(pid=127715) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:48:12.603225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:48:12.833418 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-382b18df-45dd-4fe2-9c07-8520b11ad2ac tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.717318 Aug 24 16:48:12.842055 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 6/14] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:48:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 3727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 16:48:12.853690 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3bf1cd1d-6e4c-4638-89ad-e4510d48028d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:12.855027 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3bf1cd1d-6e4c-4638-89ad-e4510d48028d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:12.991058 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-26b9c2ec-6c1a-4767-a2dc-3ab8575239a9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:12.991058 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-26b9c2ec-6c1a-4767-a2dc-3ab8575239a9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:13.106850 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3bf1cd1d-6e4c-4638-89ad-e4510d48028d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:13.126166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3bf1cd1d-6e4c-4638-89ad-e4510d48028d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1220 microversion: 2.1 time: 0.273970 Aug 24 16:48:13.129736 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 9/15] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:12 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1220 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:13.293167 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-26b9c2ec-6c1a-4767-a2dc-3ab8575239a9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:13.305251 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-26b9c2ec-6c1a-4767-a2dc-3ab8575239a9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1214 microversion: 2.1 time: 0.323889 Aug 24 16:48:13.307037 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 7/16] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:12 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1214 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:13.610378 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-314409272", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:13.736787 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] validate_networks() for [('ce570f83-6f1d-44d5-bf3a-fed77a6a5242', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:48:14.338015 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2b728556-04b3-4816-9af8-28a1e0a62c2b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:14.338712 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2b728556-04b3-4816-9af8-28a1e0a62c2b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:14.351768 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b728556-04b3-4816-9af8-28a1e0a62c2b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:14.352966 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b728556-04b3-4816-9af8-28a1e0a62c2b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:14.361879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b728556-04b3-4816-9af8-28a1e0a62c2b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:14.363039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b728556-04b3-4816-9af8-28a1e0a62c2b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:14.363891 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b728556-04b3-4816-9af8-28a1e0a62c2b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:14.364786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b728556-04b3-4816-9af8-28a1e0a62c2b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:14.757197 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2b728556-04b3-4816-9af8-28a1e0a62c2b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:14.777071 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2b728556-04b3-4816-9af8-28a1e0a62c2b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1210 microversion: 2.1 time: 0.439332 Aug 24 16:48:14.777746 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 8/17] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:14 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1210 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:14.808568 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:48:14.811260 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:48:14.811882 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:48:14.812315 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:48:14.813316 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:48:14.842107 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:14.845052 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:14.846265 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:14.849722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:14.850445 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:14.851425 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:14.915008 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Getting quotas for project 42f5635b43e74a96a56d56cccbc111b5. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:48:14.927769 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Getting quotas for user 45913fc3d9ba42ea9e971db25e656c61 and project 42f5635b43e74a96a56d56cccbc111b5. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:48:14.945157 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:48:14.947542 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:48:15.141580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3b442d7b-9c38-4fbb-92ce-9de69be93080 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.532433 Aug 24 16:48:15.153611 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 10/18] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:48:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:48:15.153783 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3a56c05b-2f32-452d-95f3-68fb3df4b8c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:15.159663 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3a56c05b-2f32-452d-95f3-68fb3df4b8c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:15.485227 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3a56c05b-2f32-452d-95f3-68fb3df4b8c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:15.497525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3a56c05b-2f32-452d-95f3-68fb3df4b8c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1221 microversion: 2.1 time: 0.348827 Aug 24 16:48:15.498878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 9/19] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:15 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1221 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:15.801509 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-86b756eb-aa82-44f3-afdf-84a4890856f6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:15.807028 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-86b756eb-aa82-44f3-afdf-84a4890856f6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:15.816387 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86b756eb-aa82-44f3-afdf-84a4890856f6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:15.821047 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86b756eb-aa82-44f3-afdf-84a4890856f6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:15.823191 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86b756eb-aa82-44f3-afdf-84a4890856f6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:15.826400 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86b756eb-aa82-44f3-afdf-84a4890856f6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:15.829471 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86b756eb-aa82-44f3-afdf-84a4890856f6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:15.831463 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86b756eb-aa82-44f3-afdf-84a4890856f6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:16.204035 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-86b756eb-aa82-44f3-afdf-84a4890856f6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:16.235782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-86b756eb-aa82-44f3-afdf-84a4890856f6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1274 microversion: 2.1 time: 0.438802 Aug 24 16:48:16.240658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 11/20] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:15 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1274 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:16.522175 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6cfd8717-ae4f-43bf-bf2e-e2e99902bdc2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:16.523552 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6cfd8717-ae4f-43bf-bf2e-e2e99902bdc2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:16.813632 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6cfd8717-ae4f-43bf-bf2e-e2e99902bdc2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:16.830805 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6cfd8717-ae4f-43bf-bf2e-e2e99902bdc2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1221 microversion: 2.1 time: 0.309232 Aug 24 16:48:16.832694 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 10/21] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:16 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1221 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:17.257980 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b692e609-438b-49f1-81f5-43a34c233f0a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:17.280236 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b692e609-438b-49f1-81f5-43a34c233f0a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:17.310741 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b692e609-438b-49f1-81f5-43a34c233f0a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:17.317958 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b692e609-438b-49f1-81f5-43a34c233f0a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:17.322565 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b692e609-438b-49f1-81f5-43a34c233f0a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:17.323575 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b692e609-438b-49f1-81f5-43a34c233f0a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:17.324191 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b692e609-438b-49f1-81f5-43a34c233f0a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:17.344168 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b692e609-438b-49f1-81f5-43a34c233f0a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:17.376115 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1597724452", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6feb1e1a-254e-49ca-8dd8-13cc9f9704e2"}], "security_groups": [{"name": "tempest-securitygroup--319753884"}], "key_name": "tempest-keypair-1429959760", "user_data": "}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:17.694246 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b692e609-438b-49f1-81f5-43a34c233f0a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:17.719351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b692e609-438b-49f1-81f5-43a34c233f0a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1272 microversion: 2.1 time: 0.465166 Aug 24 16:48:17.721227 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 12/22] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:17 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1272 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:17.857932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-69a9c018-23ac-456a-8f39-2a141071a23d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:17.858562 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-69a9c018-23ac-456a-8f39-2a141071a23d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:17.870026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69a9c018-23ac-456a-8f39-2a141071a23d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:17.870647 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69a9c018-23ac-456a-8f39-2a141071a23d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:17.871166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69a9c018-23ac-456a-8f39-2a141071a23d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:17.871959 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69a9c018-23ac-456a-8f39-2a141071a23d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:17.874037 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69a9c018-23ac-456a-8f39-2a141071a23d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:17.876911 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69a9c018-23ac-456a-8f39-2a141071a23d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:17.913548 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.network.neutron [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] validate_networks() for [('6feb1e1a-254e-49ca-8dd8-13cc9f9704e2', None, None, None, None, None)] {{(pid=127715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:48:18.198517 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-69a9c018-23ac-456a-8f39-2a141071a23d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:18.218422 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-69a9c018-23ac-456a-8f39-2a141071a23d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1217 microversion: 2.1 time: 0.362113 Aug 24 16:48:18.223305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 13/23] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:17 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1217 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:18.234702 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-982225597", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4108caa5-f8d0-4511-be15-eaaba4ff32ab"}], "security_groups": [{"name": "tempest-securitygroup--1644537085"}], "key_name": "tempest-keypair-1152618529", "user_data": "}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:18.816227 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] validate_networks() for [('4108caa5-f8d0-4511-be15-eaaba4ff32ab', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:48:20.681979 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Flavor limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:48:20.684983 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Image limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:48:20.684983 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Flavor pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:48:20.684983 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Image pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:48:20.684983 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:48:20.702571 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.702571 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.702571 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:20.705202 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.705692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.708796 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:20.730364 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:48:20.731569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:48:20.732666 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:48:20.733285 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:48:20.733947 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:48:20.761812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.782650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.785185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:20.787329 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.792090 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.800124 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:20.819496 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Getting quotas for project 525245253a2d49c48ef009a4d6c3cd51. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:48:20.840596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for project 6b5b284e0b47422592057492601db382. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:48:20.846021 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for user 88efd5eb09064aa2aa89e6d9580c6476 and project 6b5b284e0b47422592057492601db382. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:48:20.854229 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Getting quotas for user 7a930257a6584b04bae278aa83940264 and project 525245253a2d49c48ef009a4d6c3cd51. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:48:20.886267 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:48:20.891886 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:48:20.940884 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Going to run 1 instances... {{(pid=127715) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:48:20.955579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:48:21.138231 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c16dc5df-c0fb-41ae-a648-9e6c59e688a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.913766 Aug 24 16:48:21.141387 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 14/24] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:48:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 2917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:48:21.162430 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-08ea580d-9dd5-4423-9145-bc3ad9bc866b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:21.171924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-08ea580d-9dd5-4423-9145-bc3ad9bc866b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:21.206200 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08ea580d-9dd5-4423-9145-bc3ad9bc866b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:21.216757 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08ea580d-9dd5-4423-9145-bc3ad9bc866b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:21.220568 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08ea580d-9dd5-4423-9145-bc3ad9bc866b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:21.226287 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08ea580d-9dd5-4423-9145-bc3ad9bc866b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:21.227113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08ea580d-9dd5-4423-9145-bc3ad9bc866b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:21.229076 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08ea580d-9dd5-4423-9145-bc3ad9bc866b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:21.238664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-65116c24-89d8-4898-875e-80174a98eb85 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.870818 Aug 24 16:48:21.243923 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 11/25] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Aug 24 16:48:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 3878 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 16:48:21.282326 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-84643237-2505-496a-89ba-ab781fd27330 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:21.285438 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-84643237-2505-496a-89ba-ab781fd27330 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:21.313269 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-84643237-2505-496a-89ba-ab781fd27330 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:21.316508 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-84643237-2505-496a-89ba-ab781fd27330 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:21.318597 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-84643237-2505-496a-89ba-ab781fd27330 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:21.319623 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-84643237-2505-496a-89ba-ab781fd27330 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:21.322173 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-84643237-2505-496a-89ba-ab781fd27330 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:21.325434 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-84643237-2505-496a-89ba-ab781fd27330 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:21.599112 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-84643237-2505-496a-89ba-ab781fd27330 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:21.642734 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-84643237-2505-496a-89ba-ab781fd27330 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1279 microversion: 2.1 time: 0.374218 Aug 24 16:48:21.646291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 12/26] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:21 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1279 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:21.651634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b384cb6e-098d-4b12-b4c1-f4af38a8958a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:21.652258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b384cb6e-098d-4b12-b4c1-f4af38a8958a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:21.964061 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-08ea580d-9dd5-4423-9145-bc3ad9bc866b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:21.975655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b384cb6e-098d-4b12-b4c1-f4af38a8958a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:21.986447 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b384cb6e-098d-4b12-b4c1-f4af38a8958a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1241 microversion: 2.1 time: 0.339010 Aug 24 16:48:21.987196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-08ea580d-9dd5-4423-9145-bc3ad9bc866b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.842231 Aug 24 16:48:22.003401 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 13/27] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:21 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1241 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:22.005501 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 15/28] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:21 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:22.013922 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7935816c-4684-4965-a0c4-067b9d9ccd01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:22.016486 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7935816c-4684-4965-a0c4-067b9d9ccd01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:22.302691 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7935816c-4684-4965-a0c4-067b9d9ccd01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:22.330411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7935816c-4684-4965-a0c4-067b9d9ccd01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:22.332984 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7935816c-4684-4965-a0c4-067b9d9ccd01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:22.340777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7935816c-4684-4965-a0c4-067b9d9ccd01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1282 microversion: 2.20 time: 0.335488 Aug 24 16:48:22.341710 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 14/29] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:22 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1282 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:22.668725 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-291b68d5-b0b1-403a-b195-90c8be3ef305 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:22.669614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-291b68d5-b0b1-403a-b195-90c8be3ef305 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:22.690635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-291b68d5-b0b1-403a-b195-90c8be3ef305 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.695128 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-291b68d5-b0b1-403a-b195-90c8be3ef305 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.700823 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-291b68d5-b0b1-403a-b195-90c8be3ef305 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.704748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-291b68d5-b0b1-403a-b195-90c8be3ef305 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.707446 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-291b68d5-b0b1-403a-b195-90c8be3ef305 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.723852 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-291b68d5-b0b1-403a-b195-90c8be3ef305 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.180164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-291b68d5-b0b1-403a-b195-90c8be3ef305 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:23.193696 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-291b68d5-b0b1-403a-b195-90c8be3ef305 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1279 microversion: 2.1 time: 0.530225 Aug 24 16:48:23.195075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 16/30] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:22 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1279 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:23.212836 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9d6ffbbd-0bc1-44fd-b7cd-ebdf98d084d6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:23.213098 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9d6ffbbd-0bc1-44fd-b7cd-ebdf98d084d6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:23.240443 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d6ffbbd-0bc1-44fd-b7cd-ebdf98d084d6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.241212 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d6ffbbd-0bc1-44fd-b7cd-ebdf98d084d6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.241876 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d6ffbbd-0bc1-44fd-b7cd-ebdf98d084d6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.245094 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d6ffbbd-0bc1-44fd-b7cd-ebdf98d084d6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.245857 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d6ffbbd-0bc1-44fd-b7cd-ebdf98d084d6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.247813 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d6ffbbd-0bc1-44fd-b7cd-ebdf98d084d6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.295515 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-f64a5e0a-cd3f-4c9d-8a4f-4ab8e2cec952 req-212e23e2-39cf-4e3d-ab3f-086a4e2d3fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "568dd29c-4de9-49b4-84f1-44183e65c82d", "tag": "5cff7808-c87f-4402-a7eb-99555211c7b8"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:23.332566 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f64a5e0a-cd3f-4c9d-8a4f-4ab8e2cec952 req-212e23e2-39cf-4e3d-ab3f-086a4e2d3fb9 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.341446 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f64a5e0a-cd3f-4c9d-8a4f-4ab8e2cec952 req-212e23e2-39cf-4e3d-ab3f-086a4e2d3fb9 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.341446 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f64a5e0a-cd3f-4c9d-8a4f-4ab8e2cec952 req-212e23e2-39cf-4e3d-ab3f-086a4e2d3fb9 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.411791 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-f64a5e0a-cd3f-4c9d-8a4f-4ab8e2cec952 req-212e23e2-39cf-4e3d-ab3f-086a4e2d3fb9 service nova] Creating event network-changed:5cff7808-c87f-4402-a7eb-99555211c7b8 for instance 568dd29c-4de9-49b4-84f1-44183e65c82d on hv-cinder-85220 Aug 24 16:48:23.412676 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f64a5e0a-cd3f-4c9d-8a4f-4ab8e2cec952 req-212e23e2-39cf-4e3d-ab3f-086a4e2d3fb9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 16:48:23.413349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f64a5e0a-cd3f-4c9d-8a4f-4ab8e2cec952 req-212e23e2-39cf-4e3d-ab3f-086a4e2d3fb9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 16:48:23.414601 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab3d05ac-a910-458d-ba3a-26abd9f69c38 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.425025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab3d05ac-a910-458d-ba3a-26abd9f69c38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.425885 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab3d05ac-a910-458d-ba3a-26abd9f69c38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.432033 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab3d05ac-a910-458d-ba3a-26abd9f69c38 None None] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.432958 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab3d05ac-a910-458d-ba3a-26abd9f69c38 None None] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.434193 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab3d05ac-a910-458d-ba3a-26abd9f69c38 None None] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.471238 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.compute.rpcapi [None req-ab3d05ac-a910-458d-ba3a-26abd9f69c38 None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 16:48:23.472761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab3d05ac-a910-458d-ba3a-26abd9f69c38 None None] Releasing lock "compute-rpcapi-router" {{(pid=127715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 16:48:23.514871 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ab3d05ac-a910-458d-ba3a-26abd9f69c38 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.773743 Aug 24 16:48:23.517284 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 15/31] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:48:23.528808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-66c71585-bf2f-4116-9298-d1f500d3da4c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:23.530600 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-66c71585-bf2f-4116-9298-d1f500d3da4c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:23.538785 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66c71585-bf2f-4116-9298-d1f500d3da4c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.548563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66c71585-bf2f-4116-9298-d1f500d3da4c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.548563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66c71585-bf2f-4116-9298-d1f500d3da4c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.548563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66c71585-bf2f-4116-9298-d1f500d3da4c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.548563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66c71585-bf2f-4116-9298-d1f500d3da4c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.549541 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66c71585-bf2f-4116-9298-d1f500d3da4c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.888861 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-66c71585-bf2f-4116-9298-d1f500d3da4c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:23.903274 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-66c71585-bf2f-4116-9298-d1f500d3da4c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1245 microversion: 2.1 time: 0.383291 Aug 24 16:48:23.905029 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 16/32] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:23 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1245 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:23.919057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-51cfc733-6e19-4233-8120-2093daefd16b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:23.941797 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-51cfc733-6e19-4233-8120-2093daefd16b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:23.960518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-51cfc733-6e19-4233-8120-2093daefd16b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.961259 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-51cfc733-6e19-4233-8120-2093daefd16b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.964829 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-51cfc733-6e19-4233-8120-2093daefd16b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:23.965842 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-51cfc733-6e19-4233-8120-2093daefd16b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:23.966505 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-51cfc733-6e19-4233-8120-2093daefd16b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:23.967093 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-51cfc733-6e19-4233-8120-2093daefd16b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:24.101970 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9d6ffbbd-0bc1-44fd-b7cd-ebdf98d084d6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:24.117875 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9d6ffbbd-0bc1-44fd-b7cd-ebdf98d084d6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.919102 Aug 24 16:48:24.122022 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 17/33] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:23 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:24.216058 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a4ced51d-af19-4bdb-a03f-7d1f398541cb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:24.217483 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a4ced51d-af19-4bdb-a03f-7d1f398541cb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:24.221611 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:24.230629 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4ced51d-af19-4bdb-a03f-7d1f398541cb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:24.232698 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4ced51d-af19-4bdb-a03f-7d1f398541cb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:24.233391 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4ced51d-af19-4bdb-a03f-7d1f398541cb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:24.234847 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4ced51d-af19-4bdb-a03f-7d1f398541cb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:24.235501 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4ced51d-af19-4bdb-a03f-7d1f398541cb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:24.237915 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4ced51d-af19-4bdb-a03f-7d1f398541cb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:24.240350 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-51cfc733-6e19-4233-8120-2093daefd16b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:24.261139 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-51cfc733-6e19-4233-8120-2093daefd16b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:24.263298 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-51cfc733-6e19-4233-8120-2093daefd16b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:24.264734 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-51cfc733-6e19-4233-8120-2093daefd16b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1278 microversion: 2.20 time: 0.353994 Aug 24 16:48:24.265800 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 17/34] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:23 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1278 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:24.350365 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a4ced51d-af19-4bdb-a03f-7d1f398541cb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:24.363680 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a4ced51d-af19-4bdb-a03f-7d1f398541cb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1279 microversion: 2.1 time: 0.152495 Aug 24 16:48:24.367602 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 18/35] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:24 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:24.925088 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0b499e91-e1bf-4be3-a41f-c439917fdf9d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:24.925739 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0b499e91-e1bf-4be3-a41f-c439917fdf9d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:24.932999 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0b499e91-e1bf-4be3-a41f-c439917fdf9d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:24.937296 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0b499e91-e1bf-4be3-a41f-c439917fdf9d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:24.941246 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0b499e91-e1bf-4be3-a41f-c439917fdf9d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:24.945584 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0b499e91-e1bf-4be3-a41f-c439917fdf9d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:24.949053 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0b499e91-e1bf-4be3-a41f-c439917fdf9d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:24.950368 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0b499e91-e1bf-4be3-a41f-c439917fdf9d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:25.142870 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dcd3a372-75bc-44f5-a858-10f10d7b0f6a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:25.143750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dcd3a372-75bc-44f5-a858-10f10d7b0f6a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:25.155597 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0b499e91-e1bf-4be3-a41f-c439917fdf9d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:25.161919 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcd3a372-75bc-44f5-a858-10f10d7b0f6a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:25.163899 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcd3a372-75bc-44f5-a858-10f10d7b0f6a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:25.164386 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcd3a372-75bc-44f5-a858-10f10d7b0f6a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:25.165678 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcd3a372-75bc-44f5-a858-10f10d7b0f6a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:25.166151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcd3a372-75bc-44f5-a858-10f10d7b0f6a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:25.170888 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0b499e91-e1bf-4be3-a41f-c439917fdf9d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1293 microversion: 2.1 time: 0.244367 Aug 24 16:48:25.182425 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcd3a372-75bc-44f5-a858-10f10d7b0f6a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:25.185571 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 18/36] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:24 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1293 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:25.293380 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-36ed66ae-14e0-456f-863b-87e98a161f21 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:25.294126 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-36ed66ae-14e0-456f-863b-87e98a161f21 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:25.305756 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36ed66ae-14e0-456f-863b-87e98a161f21 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:25.311238 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36ed66ae-14e0-456f-863b-87e98a161f21 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:25.313008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36ed66ae-14e0-456f-863b-87e98a161f21 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:25.314313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36ed66ae-14e0-456f-863b-87e98a161f21 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:25.316988 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36ed66ae-14e0-456f-863b-87e98a161f21 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:25.318747 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36ed66ae-14e0-456f-863b-87e98a161f21 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:25.502449 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-36ed66ae-14e0-456f-863b-87e98a161f21 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:25.513366 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-36ed66ae-14e0-456f-863b-87e98a161f21 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:25.525298 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-36ed66ae-14e0-456f-863b-87e98a161f21 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:25.526945 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-36ed66ae-14e0-456f-863b-87e98a161f21 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1334 microversion: 2.20 time: 0.238073 Aug 24 16:48:25.528083 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 19/37] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:25 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1334 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:25.533152 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3bf1b6ea-3d2f-4349-abe0-a00354211374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:25.533978 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3bf1b6ea-3d2f-4349-abe0-a00354211374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:25.548688 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3bf1b6ea-3d2f-4349-abe0-a00354211374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:25.553355 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3bf1b6ea-3d2f-4349-abe0-a00354211374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:25.553679 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3bf1b6ea-3d2f-4349-abe0-a00354211374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:25.554414 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3bf1b6ea-3d2f-4349-abe0-a00354211374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:25.554870 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3bf1b6ea-3d2f-4349-abe0-a00354211374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:25.555292 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3bf1b6ea-3d2f-4349-abe0-a00354211374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:25.789327 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-dcd3a372-75bc-44f5-a858-10f10d7b0f6a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:25.803131 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dcd3a372-75bc-44f5-a858-10f10d7b0f6a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.661674 Aug 24 16:48:25.803778 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 19/38] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:25 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:26.020448 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3bf1b6ea-3d2f-4349-abe0-a00354211374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:26.033914 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3bf1b6ea-3d2f-4349-abe0-a00354211374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.502213 Aug 24 16:48:26.038990 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 20/39] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:25 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:26.194007 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-20026cd1-80a7-40f5-89ae-02e30712e907 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:26.194649 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-20026cd1-80a7-40f5-89ae-02e30712e907 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:26.206506 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20026cd1-80a7-40f5-89ae-02e30712e907 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.210860 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20026cd1-80a7-40f5-89ae-02e30712e907 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.213173 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20026cd1-80a7-40f5-89ae-02e30712e907 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:26.213173 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20026cd1-80a7-40f5-89ae-02e30712e907 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.213173 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20026cd1-80a7-40f5-89ae-02e30712e907 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.213173 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20026cd1-80a7-40f5-89ae-02e30712e907 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:26.445735 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-20026cd1-80a7-40f5-89ae-02e30712e907 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:26.480024 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-20026cd1-80a7-40f5-89ae-02e30712e907 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1301 microversion: 2.1 time: 0.287040 Aug 24 16:48:26.482120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 20/40] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:26 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1301 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:26.560718 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e6a40f63-cc49-4c66-b4a8-4efd4cdf8e75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:26.560718 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e6a40f63-cc49-4c66-b4a8-4efd4cdf8e75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:26.565274 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6a40f63-cc49-4c66-b4a8-4efd4cdf8e75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.566103 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6a40f63-cc49-4c66-b4a8-4efd4cdf8e75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.566542 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6a40f63-cc49-4c66-b4a8-4efd4cdf8e75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:26.567622 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6a40f63-cc49-4c66-b4a8-4efd4cdf8e75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.568451 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6a40f63-cc49-4c66-b4a8-4efd4cdf8e75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.569188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6a40f63-cc49-4c66-b4a8-4efd4cdf8e75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:26.596728 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-6d0975fb-52d0-48ca-b6d8-04919238bf51 req-fede2942-d54f-4976-a2f7-366262ec764e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b", "tag": "eebf25cb-9859-40a8-8cd8-a778ec3005bd"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:26.609639 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-6d0975fb-52d0-48ca-b6d8-04919238bf51 req-fede2942-d54f-4976-a2f7-366262ec764e service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.611195 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-6d0975fb-52d0-48ca-b6d8-04919238bf51 req-fede2942-d54f-4976-a2f7-366262ec764e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.611717 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-6d0975fb-52d0-48ca-b6d8-04919238bf51 req-fede2942-d54f-4976-a2f7-366262ec764e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:26.646979 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-6d0975fb-52d0-48ca-b6d8-04919238bf51 req-fede2942-d54f-4976-a2f7-366262ec764e service nova] Creating event network-changed:eebf25cb-9859-40a8-8cd8-a778ec3005bd for instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b on hv-cinder-85220 Aug 24 16:48:26.654772 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-6d0975fb-52d0-48ca-b6d8-04919238bf51 req-fede2942-d54f-4976-a2f7-366262ec764e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210067 Aug 24 16:48:26.656699 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 21/41] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:26.807958 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6a40f63-cc49-4c66-b4a8-4efd4cdf8e75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:26.821997 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6a40f63-cc49-4c66-b4a8-4efd4cdf8e75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:26.823828 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6a40f63-cc49-4c66-b4a8-4efd4cdf8e75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:26.824364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-91242200-723d-434a-b6c7-3e2a3edea7ef tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:26.825438 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-91242200-723d-434a-b6c7-3e2a3edea7ef tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:26.830573 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e6a40f63-cc49-4c66-b4a8-4efd4cdf8e75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1334 microversion: 2.20 time: 0.278745 Aug 24 16:48:26.833006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 21/42] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:26 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1334 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:26.835079 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-91242200-723d-434a-b6c7-3e2a3edea7ef tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.841330 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-91242200-723d-434a-b6c7-3e2a3edea7ef tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.841812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-91242200-723d-434a-b6c7-3e2a3edea7ef tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:26.846933 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-91242200-723d-434a-b6c7-3e2a3edea7ef tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:26.846933 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-91242200-723d-434a-b6c7-3e2a3edea7ef tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:26.846933 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-91242200-723d-434a-b6c7-3e2a3edea7ef tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.056368 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8ada64bd-bb7e-49db-b9a1-ba5c636a658f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:27.057457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8ada64bd-bb7e-49db-b9a1-ba5c636a658f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:27.075515 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ada64bd-bb7e-49db-b9a1-ba5c636a658f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.075515 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ada64bd-bb7e-49db-b9a1-ba5c636a658f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.075515 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ada64bd-bb7e-49db-b9a1-ba5c636a658f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.076624 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ada64bd-bb7e-49db-b9a1-ba5c636a658f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.077484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ada64bd-bb7e-49db-b9a1-ba5c636a658f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.078157 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ada64bd-bb7e-49db-b9a1-ba5c636a658f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.816646 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-91242200-723d-434a-b6c7-3e2a3edea7ef tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:27.841078 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8ada64bd-bb7e-49db-b9a1-ba5c636a658f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:27.844056 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-91242200-723d-434a-b6c7-3e2a3edea7ef tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 1.024566 Aug 24 16:48:27.847696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 22/43] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:26 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:27.861674 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-bae54328-aa2d-4fea-bf36-a67f59c4b422 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:27.862400 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8ada64bd-bb7e-49db-b9a1-ba5c636a658f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.801779 Aug 24 16:48:27.863059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-bae54328-aa2d-4fea-bf36-a67f59c4b422 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:27.863166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 22/44] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:27 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:27.868219 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-25ac4040-08d0-4b54-8681-c5c5cb5d0401 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:27.868871 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-25ac4040-08d0-4b54-8681-c5c5cb5d0401 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:27.882723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25ac4040-08d0-4b54-8681-c5c5cb5d0401 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.883212 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25ac4040-08d0-4b54-8681-c5c5cb5d0401 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.885925 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25ac4040-08d0-4b54-8681-c5c5cb5d0401 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.891720 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25ac4040-08d0-4b54-8681-c5c5cb5d0401 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.892518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25ac4040-08d0-4b54-8681-c5c5cb5d0401 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.893127 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25ac4040-08d0-4b54-8681-c5c5cb5d0401 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.900482 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bae54328-aa2d-4fea-bf36-a67f59c4b422 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.905062 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bae54328-aa2d-4fea-bf36-a67f59c4b422 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.907190 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bae54328-aa2d-4fea-bf36-a67f59c4b422 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:27.909030 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bae54328-aa2d-4fea-bf36-a67f59c4b422 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:27.911279 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bae54328-aa2d-4fea-bf36-a67f59c4b422 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:27.912023 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bae54328-aa2d-4fea-bf36-a67f59c4b422 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:28.097404 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-25ac4040-08d0-4b54-8681-c5c5cb5d0401 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:28.108465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-bae54328-aa2d-4fea-bf36-a67f59c4b422 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:28.122588 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-25ac4040-08d0-4b54-8681-c5c5cb5d0401 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:28.122797 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-bae54328-aa2d-4fea-bf36-a67f59c4b422 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1299 microversion: 2.1 time: 0.271427 Aug 24 16:48:28.122797 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 23/45] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:27 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1299 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:28.123591 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-25ac4040-08d0-4b54-8681-c5c5cb5d0401 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:28.124988 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-25ac4040-08d0-4b54-8681-c5c5cb5d0401 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1340 microversion: 2.20 time: 0.260987 Aug 24 16:48:28.140790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 23/46] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:27 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1340 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:28.725541 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-731a9c34-3eef-4d46-bda5-39156192a9c6 req-f3c5ebc9-eacf-4ed4-bda8-3138dc5206cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5377571a-2ee1-4cb8-b47e-cd4f48808e8b", "tag": "5892788f-be73-4ceb-af43-492175260ae5"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:28.751517 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-731a9c34-3eef-4d46-bda5-39156192a9c6 req-f3c5ebc9-eacf-4ed4-bda8-3138dc5206cf service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:28.754195 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-731a9c34-3eef-4d46-bda5-39156192a9c6 req-f3c5ebc9-eacf-4ed4-bda8-3138dc5206cf service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:28.754821 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-731a9c34-3eef-4d46-bda5-39156192a9c6 req-f3c5ebc9-eacf-4ed4-bda8-3138dc5206cf service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:28.770220 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-731a9c34-3eef-4d46-bda5-39156192a9c6 req-f3c5ebc9-eacf-4ed4-bda8-3138dc5206cf service nova] Creating event network-changed:5892788f-be73-4ceb-af43-492175260ae5 for instance 5377571a-2ee1-4cb8-b47e-cd4f48808e8b on hv-cinder-85220 Aug 24 16:48:28.787406 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-731a9c34-3eef-4d46-bda5-39156192a9c6 req-f3c5ebc9-eacf-4ed4-bda8-3138dc5206cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066114 Aug 24 16:48:28.788650 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 24/47] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:28.866094 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-495a1201-a494-435b-9ab4-95c4dd7950cf tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:28.867500 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-495a1201-a494-435b-9ab4-95c4dd7950cf tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:28.875215 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-495a1201-a494-435b-9ab4-95c4dd7950cf tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:28.875994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-495a1201-a494-435b-9ab4-95c4dd7950cf tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:28.882137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-495a1201-a494-435b-9ab4-95c4dd7950cf tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:28.883090 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-495a1201-a494-435b-9ab4-95c4dd7950cf tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:28.883626 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-495a1201-a494-435b-9ab4-95c4dd7950cf tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:28.884062 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-495a1201-a494-435b-9ab4-95c4dd7950cf tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:28.888034 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b5453cf5-e9cb-4515-800b-91a905a19663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:28.889293 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b5453cf5-e9cb-4515-800b-91a905a19663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:28.908727 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5453cf5-e9cb-4515-800b-91a905a19663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:28.909471 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5453cf5-e9cb-4515-800b-91a905a19663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:28.910981 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5453cf5-e9cb-4515-800b-91a905a19663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:28.911895 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5453cf5-e9cb-4515-800b-91a905a19663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:28.912538 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5453cf5-e9cb-4515-800b-91a905a19663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:28.913118 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5453cf5-e9cb-4515-800b-91a905a19663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.306812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-495a1201-a494-435b-9ab4-95c4dd7950cf tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:29.307632 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b5453cf5-e9cb-4515-800b-91a905a19663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:29.316633 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b5453cf5-e9cb-4515-800b-91a905a19663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.434317 Aug 24 16:48:29.321559 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 25/48] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:28 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:29.323500 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c4f7fe0c-3735-44d3-9d77-8524dea870c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:29.324255 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c4f7fe0c-3735-44d3-9d77-8524dea870c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:29.334001 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-495a1201-a494-435b-9ab4-95c4dd7950cf tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.470462 Aug 24 16:48:29.334628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 24/49] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:28 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:29.339521 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c4f7fe0c-3735-44d3-9d77-8524dea870c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.340566 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c4f7fe0c-3735-44d3-9d77-8524dea870c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.344476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a6dea876-bfe2-4960-84bd-897f69f5d43a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:29.344778 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c4f7fe0c-3735-44d3-9d77-8524dea870c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.345516 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c4f7fe0c-3735-44d3-9d77-8524dea870c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.348282 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a6dea876-bfe2-4960-84bd-897f69f5d43a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:29.349163 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c4f7fe0c-3735-44d3-9d77-8524dea870c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.349845 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c4f7fe0c-3735-44d3-9d77-8524dea870c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.367808 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6dea876-bfe2-4960-84bd-897f69f5d43a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.368819 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6dea876-bfe2-4960-84bd-897f69f5d43a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.372946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6dea876-bfe2-4960-84bd-897f69f5d43a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.373978 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6dea876-bfe2-4960-84bd-897f69f5d43a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:29.374646 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6dea876-bfe2-4960-84bd-897f69f5d43a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:29.375275 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6dea876-bfe2-4960-84bd-897f69f5d43a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:29.636103 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c4f7fe0c-3735-44d3-9d77-8524dea870c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:29.642252 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a6dea876-bfe2-4960-84bd-897f69f5d43a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:29.644505 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c4f7fe0c-3735-44d3-9d77-8524dea870c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.325073 Aug 24 16:48:29.644619 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=89 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:29.652091 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 26/50] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:29 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:29.670597 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a6dea876-bfe2-4960-84bd-897f69f5d43a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:29.673050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a6dea876-bfe2-4960-84bd-897f69f5d43a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:29.674217 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a6dea876-bfe2-4960-84bd-897f69f5d43a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.336668 Aug 24 16:48:29.700015 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 25/51] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:29 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:30.342756 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-542a1565-aae1-41cb-a6a0-3126ac4ce539 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:30.343371 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-542a1565-aae1-41cb-a6a0-3126ac4ce539 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:30.349327 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-542a1565-aae1-41cb-a6a0-3126ac4ce539 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.349813 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-542a1565-aae1-41cb-a6a0-3126ac4ce539 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.350250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-542a1565-aae1-41cb-a6a0-3126ac4ce539 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.350935 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-542a1565-aae1-41cb-a6a0-3126ac4ce539 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.351390 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-542a1565-aae1-41cb-a6a0-3126ac4ce539 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.351816 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-542a1565-aae1-41cb-a6a0-3126ac4ce539 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.359069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4c845816-0ff7-4432-9051-22716b905d23 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:30.359772 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4c845816-0ff7-4432-9051-22716b905d23 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:30.367390 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c845816-0ff7-4432-9051-22716b905d23 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.367549 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c845816-0ff7-4432-9051-22716b905d23 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.367955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c845816-0ff7-4432-9051-22716b905d23 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.368668 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c845816-0ff7-4432-9051-22716b905d23 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.369383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c845816-0ff7-4432-9051-22716b905d23 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.369804 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c845816-0ff7-4432-9051-22716b905d23 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.539805 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-542a1565-aae1-41cb-a6a0-3126ac4ce539 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:30.550135 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-542a1565-aae1-41cb-a6a0-3126ac4ce539 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.211221 Aug 24 16:48:30.550728 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 27/52] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:30 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:30.551991 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4c845816-0ff7-4432-9051-22716b905d23 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:30.559792 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4c845816-0ff7-4432-9051-22716b905d23 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.204648 Aug 24 16:48:30.560353 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 26/53] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:30 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:30.673608 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7b37b394-4946-4db4-8a9b-ceffc09cf8bc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:30.674226 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7b37b394-4946-4db4-8a9b-ceffc09cf8bc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:30.680692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7b37b394-4946-4db4-8a9b-ceffc09cf8bc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.681193 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7b37b394-4946-4db4-8a9b-ceffc09cf8bc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.681611 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7b37b394-4946-4db4-8a9b-ceffc09cf8bc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.682291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7b37b394-4946-4db4-8a9b-ceffc09cf8bc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.682743 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7b37b394-4946-4db4-8a9b-ceffc09cf8bc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.683166 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7b37b394-4946-4db4-8a9b-ceffc09cf8bc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.697900 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-45f939b6-49f5-4348-ae9e-fc66d33e6fc5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:30.699877 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-45f939b6-49f5-4348-ae9e-fc66d33e6fc5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:30.704688 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45f939b6-49f5-4348-ae9e-fc66d33e6fc5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.705214 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45f939b6-49f5-4348-ae9e-fc66d33e6fc5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.705643 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45f939b6-49f5-4348-ae9e-fc66d33e6fc5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.706326 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45f939b6-49f5-4348-ae9e-fc66d33e6fc5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:30.706775 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45f939b6-49f5-4348-ae9e-fc66d33e6fc5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:30.707197 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45f939b6-49f5-4348-ae9e-fc66d33e6fc5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:30.825885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=6 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:30.854334 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=32 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:30.879971 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7b37b394-4946-4db4-8a9b-ceffc09cf8bc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:30.884830 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-45f939b6-49f5-4348-ae9e-fc66d33e6fc5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:30.888426 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7b37b394-4946-4db4-8a9b-ceffc09cf8bc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.218603 Aug 24 16:48:30.888998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 28/54] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:30 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:30.893404 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-45f939b6-49f5-4348-ae9e-fc66d33e6fc5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:30.894981 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-45f939b6-49f5-4348-ae9e-fc66d33e6fc5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:30.896247 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-45f939b6-49f5-4348-ae9e-fc66d33e6fc5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.202854 Aug 24 16:48:30.896824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 27/55] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:30 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:31.571182 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6da8b912-5e23-4259-8bd9-1070e26b3304 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:31.571791 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6da8b912-5e23-4259-8bd9-1070e26b3304 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:31.577848 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6da8b912-5e23-4259-8bd9-1070e26b3304 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:31.578322 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6da8b912-5e23-4259-8bd9-1070e26b3304 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:31.578751 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6da8b912-5e23-4259-8bd9-1070e26b3304 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:31.579434 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6da8b912-5e23-4259-8bd9-1070e26b3304 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:31.579884 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6da8b912-5e23-4259-8bd9-1070e26b3304 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:31.580302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6da8b912-5e23-4259-8bd9-1070e26b3304 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:31.580834 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e4fb699c-c783-430a-b297-a30176280832 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:31.581454 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e4fb699c-c783-430a-b297-a30176280832 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:31.589652 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e4fb699c-c783-430a-b297-a30176280832 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:31.590188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e4fb699c-c783-430a-b297-a30176280832 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:31.590587 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e4fb699c-c783-430a-b297-a30176280832 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:31.591358 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e4fb699c-c783-430a-b297-a30176280832 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:31.591814 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e4fb699c-c783-430a-b297-a30176280832 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:31.592242 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e4fb699c-c783-430a-b297-a30176280832 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:31.774012 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6da8b912-5e23-4259-8bd9-1070e26b3304 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:31.778402 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e4fb699c-c783-430a-b297-a30176280832 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:31.782581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6da8b912-5e23-4259-8bd9-1070e26b3304 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.215296 Aug 24 16:48:31.783242 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 29/56] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:31 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:31.786092 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e4fb699c-c783-430a-b297-a30176280832 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.209426 Aug 24 16:48:31.786670 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 28/57] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:31 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:31.909017 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-93474bb5-5947-41e7-af32-e25c2739f904 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:31.909627 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-93474bb5-5947-41e7-af32-e25c2739f904 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:31.915611 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-93474bb5-5947-41e7-af32-e25c2739f904 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:31.916088 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-93474bb5-5947-41e7-af32-e25c2739f904 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:31.916563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-93474bb5-5947-41e7-af32-e25c2739f904 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:31.917240 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-93474bb5-5947-41e7-af32-e25c2739f904 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:31.917684 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-93474bb5-5947-41e7-af32-e25c2739f904 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:31.918096 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-93474bb5-5947-41e7-af32-e25c2739f904 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:31.918850 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6e063782-0cea-4d29-8411-00a50ef74562 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:31.919465 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6e063782-0cea-4d29-8411-00a50ef74562 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:31.925505 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e063782-0cea-4d29-8411-00a50ef74562 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:31.925966 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e063782-0cea-4d29-8411-00a50ef74562 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:31.926399 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e063782-0cea-4d29-8411-00a50ef74562 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:31.927119 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e063782-0cea-4d29-8411-00a50ef74562 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:31.927654 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e063782-0cea-4d29-8411-00a50ef74562 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:31.928078 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e063782-0cea-4d29-8411-00a50ef74562 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:31.936304 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:32.109095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-93474bb5-5947-41e7-af32-e25c2739f904 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:32.112950 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6e063782-0cea-4d29-8411-00a50ef74562 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:32.117205 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-93474bb5-5947-41e7-af32-e25c2739f904 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.211996 Aug 24 16:48:32.117883 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 30/58] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:31 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:32.122042 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6e063782-0cea-4d29-8411-00a50ef74562 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:32.123546 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6e063782-0cea-4d29-8411-00a50ef74562 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:32.124670 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6e063782-0cea-4d29-8411-00a50ef74562 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.209708 Aug 24 16:48:32.125220 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 29/59] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:31 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:32.804864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3c32289c-83a5-435e-b9f3-acaffe87df6b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:32.805436 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3c32289c-83a5-435e-b9f3-acaffe87df6b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:32.807916 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=24 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:32.812723 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3c32289c-83a5-435e-b9f3-acaffe87df6b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:32.813204 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3c32289c-83a5-435e-b9f3-acaffe87df6b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:32.813637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3c32289c-83a5-435e-b9f3-acaffe87df6b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:32.813908 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c5fe6d6d-ac29-4093-b44c-27e0b3904e4f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:32.814319 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3c32289c-83a5-435e-b9f3-acaffe87df6b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:32.814514 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c5fe6d6d-ac29-4093-b44c-27e0b3904e4f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:32.814770 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3c32289c-83a5-435e-b9f3-acaffe87df6b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:32.815191 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3c32289c-83a5-435e-b9f3-acaffe87df6b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:32.820301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5fe6d6d-ac29-4093-b44c-27e0b3904e4f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:32.823074 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5fe6d6d-ac29-4093-b44c-27e0b3904e4f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:32.823074 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5fe6d6d-ac29-4093-b44c-27e0b3904e4f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:32.823074 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5fe6d6d-ac29-4093-b44c-27e0b3904e4f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:32.823074 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5fe6d6d-ac29-4093-b44c-27e0b3904e4f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:32.823364 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5fe6d6d-ac29-4093-b44c-27e0b3904e4f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.011090 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3c32289c-83a5-435e-b9f3-acaffe87df6b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:33.015159 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c5fe6d6d-ac29-4093-b44c-27e0b3904e4f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:33.018883 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3c32289c-83a5-435e-b9f3-acaffe87df6b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.217870 Aug 24 16:48:33.019468 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 31/60] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:32 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:33.023055 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c5fe6d6d-ac29-4093-b44c-27e0b3904e4f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.212835 Aug 24 16:48:33.023616 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 30/61] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:32 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:33.138351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-db8a45a7-606c-4c3b-806e-e84f5c95764d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:33.138962 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-db8a45a7-606c-4c3b-806e-e84f5c95764d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:33.144778 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db8a45a7-606c-4c3b-806e-e84f5c95764d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.145262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db8a45a7-606c-4c3b-806e-e84f5c95764d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.145735 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db8a45a7-606c-4c3b-806e-e84f5c95764d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.146484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db8a45a7-606c-4c3b-806e-e84f5c95764d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.146937 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db8a45a7-606c-4c3b-806e-e84f5c95764d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.147357 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db8a45a7-606c-4c3b-806e-e84f5c95764d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.149336 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-08b6bd13-9183-41e6-bb18-dbfd2baf9393 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:33.150638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-08b6bd13-9183-41e6-bb18-dbfd2baf9393 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:33.157660 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08b6bd13-9183-41e6-bb18-dbfd2baf9393 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.158226 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08b6bd13-9183-41e6-bb18-dbfd2baf9393 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.158662 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08b6bd13-9183-41e6-bb18-dbfd2baf9393 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.159361 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08b6bd13-9183-41e6-bb18-dbfd2baf9393 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:33.159816 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08b6bd13-9183-41e6-bb18-dbfd2baf9393 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:33.160246 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08b6bd13-9183-41e6-bb18-dbfd2baf9393 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:33.346436 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-db8a45a7-606c-4c3b-806e-e84f5c95764d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:33.349914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-08b6bd13-9183-41e6-bb18-dbfd2baf9393 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:33.354436 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-db8a45a7-606c-4c3b-806e-e84f5c95764d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.219860 Aug 24 16:48:33.355097 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 32/62] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:33 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:33.358151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-08b6bd13-9183-41e6-bb18-dbfd2baf9393 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:33.359785 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-08b6bd13-9183-41e6-bb18-dbfd2baf9393 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:33.360939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-08b6bd13-9183-41e6-bb18-dbfd2baf9393 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.215694 Aug 24 16:48:33.364334 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 31/63] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:33 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:34.040724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-92846858-1c7b-421b-a656-d8645dd7a4ad tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:34.041343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-92846858-1c7b-421b-a656-d8645dd7a4ad tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:34.043818 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=6 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:34.044562 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e68bd6ab-4f9a-4e9a-900f-7f00aeb8f8a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:34.045176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e68bd6ab-4f9a-4e9a-900f-7f00aeb8f8a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:34.045886 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:34.049498 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-92846858-1c7b-421b-a656-d8645dd7a4ad tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:34.050025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-92846858-1c7b-421b-a656-d8645dd7a4ad tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:34.050510 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-92846858-1c7b-421b-a656-d8645dd7a4ad tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:34.051137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68bd6ab-4f9a-4e9a-900f-7f00aeb8f8a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:34.051297 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-92846858-1c7b-421b-a656-d8645dd7a4ad tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:34.051625 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68bd6ab-4f9a-4e9a-900f-7f00aeb8f8a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:34.051729 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-92846858-1c7b-421b-a656-d8645dd7a4ad tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:34.052059 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68bd6ab-4f9a-4e9a-900f-7f00aeb8f8a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:34.052148 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-92846858-1c7b-421b-a656-d8645dd7a4ad tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:34.052791 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68bd6ab-4f9a-4e9a-900f-7f00aeb8f8a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:34.053242 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68bd6ab-4f9a-4e9a-900f-7f00aeb8f8a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:34.053784 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68bd6ab-4f9a-4e9a-900f-7f00aeb8f8a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:34.283796 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-92846858-1c7b-421b-a656-d8645dd7a4ad tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:34.286884 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e68bd6ab-4f9a-4e9a-900f-7f00aeb8f8a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:34.291692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-92846858-1c7b-421b-a656-d8645dd7a4ad tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.255305 Aug 24 16:48:34.292377 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 33/64] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:34 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:34.295109 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e68bd6ab-4f9a-4e9a-900f-7f00aeb8f8a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.255057 Aug 24 16:48:34.295823 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 32/65] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:34 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:34.375767 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3b75df5b-d169-45ed-8940-d768d157c15c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:34.376385 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3b75df5b-d169-45ed-8940-d768d157c15c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:34.382857 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3b75df5b-d169-45ed-8940-d768d157c15c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:34.383357 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3b75df5b-d169-45ed-8940-d768d157c15c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:34.383798 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3b75df5b-d169-45ed-8940-d768d157c15c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:34.384529 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3b75df5b-d169-45ed-8940-d768d157c15c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:34.384993 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3b75df5b-d169-45ed-8940-d768d157c15c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:34.385098 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-28352a59-77fb-4a05-a15e-dcb31c6e996f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:34.385454 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3b75df5b-d169-45ed-8940-d768d157c15c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:34.385679 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-28352a59-77fb-4a05-a15e-dcb31c6e996f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:34.393885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28352a59-77fb-4a05-a15e-dcb31c6e996f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:34.394761 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28352a59-77fb-4a05-a15e-dcb31c6e996f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:34.395463 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28352a59-77fb-4a05-a15e-dcb31c6e996f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:34.396638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28352a59-77fb-4a05-a15e-dcb31c6e996f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:34.397405 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28352a59-77fb-4a05-a15e-dcb31c6e996f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:34.398095 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28352a59-77fb-4a05-a15e-dcb31c6e996f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:34.782115 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3b75df5b-d169-45ed-8940-d768d157c15c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:34.786713 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-28352a59-77fb-4a05-a15e-dcb31c6e996f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:34.790433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3b75df5b-d169-45ed-8940-d768d157c15c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.418761 Aug 24 16:48:34.791009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 34/66] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:34 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:34.795846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-28352a59-77fb-4a05-a15e-dcb31c6e996f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:34.797438 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-28352a59-77fb-4a05-a15e-dcb31c6e996f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:34.798670 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-28352a59-77fb-4a05-a15e-dcb31c6e996f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.417449 Aug 24 16:48:34.799425 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 33/67] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:34 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:35.313518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-238e40e4-6899-44f2-8691-73ca7a74045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:35.314237 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-238e40e4-6899-44f2-8691-73ca7a74045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:35.321311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-238e40e4-6899-44f2-8691-73ca7a74045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:35.322741 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-238e40e4-6899-44f2-8691-73ca7a74045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:35.324064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-238e40e4-6899-44f2-8691-73ca7a74045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:35.324858 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-238e40e4-6899-44f2-8691-73ca7a74045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:35.325343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-238e40e4-6899-44f2-8691-73ca7a74045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:35.325777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-238e40e4-6899-44f2-8691-73ca7a74045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:35.329254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cb0a2b28-a37e-4a8f-bf1a-95beac6f6216 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:35.331132 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cb0a2b28-a37e-4a8f-bf1a-95beac6f6216 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:35.338488 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb0a2b28-a37e-4a8f-bf1a-95beac6f6216 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:35.339712 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb0a2b28-a37e-4a8f-bf1a-95beac6f6216 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:35.340890 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb0a2b28-a37e-4a8f-bf1a-95beac6f6216 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:35.342033 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb0a2b28-a37e-4a8f-bf1a-95beac6f6216 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:35.342786 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb0a2b28-a37e-4a8f-bf1a-95beac6f6216 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:35.343409 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb0a2b28-a37e-4a8f-bf1a-95beac6f6216 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:35.550013 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cb0a2b28-a37e-4a8f-bf1a-95beac6f6216 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:35.555100 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-238e40e4-6899-44f2-8691-73ca7a74045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:35.560269 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cb0a2b28-a37e-4a8f-bf1a-95beac6f6216 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.236708 Aug 24 16:48:35.561220 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 34/68] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:35 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:35.577485 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-238e40e4-6899-44f2-8691-73ca7a74045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.267879 Aug 24 16:48:35.591455 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 35/69] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:35 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:35.811961 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9f768c1a-cbab-4926-999e-f095a58b7d6a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:35.812689 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9f768c1a-cbab-4926-999e-f095a58b7d6a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:35.818698 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f768c1a-cbab-4926-999e-f095a58b7d6a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:35.819118 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f768c1a-cbab-4926-999e-f095a58b7d6a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:35.819547 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f768c1a-cbab-4926-999e-f095a58b7d6a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:35.820264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f768c1a-cbab-4926-999e-f095a58b7d6a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:35.820733 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f768c1a-cbab-4926-999e-f095a58b7d6a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:35.821152 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f768c1a-cbab-4926-999e-f095a58b7d6a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:35.828476 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-cca5f9fd-8d4f-4abd-b323-d68bafe3b5d4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:35.829242 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-cca5f9fd-8d4f-4abd-b323-d68bafe3b5d4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:35.835260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cca5f9fd-8d4f-4abd-b323-d68bafe3b5d4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:35.835820 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cca5f9fd-8d4f-4abd-b323-d68bafe3b5d4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:35.836327 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cca5f9fd-8d4f-4abd-b323-d68bafe3b5d4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:35.837135 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cca5f9fd-8d4f-4abd-b323-d68bafe3b5d4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:35.837661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cca5f9fd-8d4f-4abd-b323-d68bafe3b5d4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:35.838160 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cca5f9fd-8d4f-4abd-b323-d68bafe3b5d4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:36.059505 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9f768c1a-cbab-4926-999e-f095a58b7d6a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:36.071105 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cca5f9fd-8d4f-4abd-b323-d68bafe3b5d4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:36.077144 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9f768c1a-cbab-4926-999e-f095a58b7d6a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.269712 Aug 24 16:48:36.084243 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 35/70] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:35 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:36.084364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cca5f9fd-8d4f-4abd-b323-d68bafe3b5d4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:36.084364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cca5f9fd-8d4f-4abd-b323-d68bafe3b5d4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:36.085689 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-cca5f9fd-8d4f-4abd-b323-d68bafe3b5d4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.260924 Aug 24 16:48:36.086245 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 36/71] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:35 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:36.581072 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d25a60a3-6293-45ac-801f-82a6ffa6583a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:36.581687 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d25a60a3-6293-45ac-801f-82a6ffa6583a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:36.587619 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d25a60a3-6293-45ac-801f-82a6ffa6583a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:36.588098 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d25a60a3-6293-45ac-801f-82a6ffa6583a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:36.589072 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d25a60a3-6293-45ac-801f-82a6ffa6583a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:36.589799 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d25a60a3-6293-45ac-801f-82a6ffa6583a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:36.590257 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d25a60a3-6293-45ac-801f-82a6ffa6583a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:36.590684 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d25a60a3-6293-45ac-801f-82a6ffa6583a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:36.599099 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6a1a5646-5f82-40a4-a815-c808a6a86c00 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:36.600218 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6a1a5646-5f82-40a4-a815-c808a6a86c00 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:36.607885 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a1a5646-5f82-40a4-a815-c808a6a86c00 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:36.609353 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a1a5646-5f82-40a4-a815-c808a6a86c00 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:36.609353 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a1a5646-5f82-40a4-a815-c808a6a86c00 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:36.609560 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a1a5646-5f82-40a4-a815-c808a6a86c00 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:36.609980 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a1a5646-5f82-40a4-a815-c808a6a86c00 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:36.610405 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a1a5646-5f82-40a4-a815-c808a6a86c00 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:36.799281 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d25a60a3-6293-45ac-801f-82a6ffa6583a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:36.803294 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6a1a5646-5f82-40a4-a815-c808a6a86c00 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:36.813201 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d25a60a3-6293-45ac-801f-82a6ffa6583a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.235833 Aug 24 16:48:36.813492 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6a1a5646-5f82-40a4-a815-c808a6a86c00 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.218228 Aug 24 16:48:36.814082 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 37/72] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:36 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:36.814910 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 36/73] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:36 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:37.098997 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-eb878153-9ad2-4aa1-862b-7ad581859c45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:37.100185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-eb878153-9ad2-4aa1-862b-7ad581859c45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:37.107498 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eb878153-9ad2-4aa1-862b-7ad581859c45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:37.108110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eb878153-9ad2-4aa1-862b-7ad581859c45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:37.108223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0ae18f7c-8be5-4be4-b19d-6424d3a94030 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:37.108763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eb878153-9ad2-4aa1-862b-7ad581859c45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:37.108889 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0ae18f7c-8be5-4be4-b19d-6424d3a94030 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:37.109877 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eb878153-9ad2-4aa1-862b-7ad581859c45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:37.110397 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eb878153-9ad2-4aa1-862b-7ad581859c45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:37.111161 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eb878153-9ad2-4aa1-862b-7ad581859c45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:37.114742 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ae18f7c-8be5-4be4-b19d-6424d3a94030 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:37.115227 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ae18f7c-8be5-4be4-b19d-6424d3a94030 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:37.116440 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ae18f7c-8be5-4be4-b19d-6424d3a94030 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:37.116440 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ae18f7c-8be5-4be4-b19d-6424d3a94030 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:37.116826 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ae18f7c-8be5-4be4-b19d-6424d3a94030 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:37.117248 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ae18f7c-8be5-4be4-b19d-6424d3a94030 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:37.317432 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-eb878153-9ad2-4aa1-862b-7ad581859c45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:37.323441 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0ae18f7c-8be5-4be4-b19d-6424d3a94030 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:37.327482 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-eb878153-9ad2-4aa1-862b-7ad581859c45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.232094 Aug 24 16:48:37.327482 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 38/74] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:37 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:37.332839 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0ae18f7c-8be5-4be4-b19d-6424d3a94030 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:37.334444 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0ae18f7c-8be5-4be4-b19d-6424d3a94030 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:37.335543 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0ae18f7c-8be5-4be4-b19d-6424d3a94030 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.231196 Aug 24 16:48:37.336259 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 37/75] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:37 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:37.837661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3f0da9dd-f28f-4f52-9c3f-538474fc981b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:37.839343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3f0da9dd-f28f-4f52-9c3f-538474fc981b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:37.840199 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9a145cd0-e5bb-4a36-84ff-96f1890ae95a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:37.841122 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9a145cd0-e5bb-4a36-84ff-96f1890ae95a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:37.847021 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3f0da9dd-f28f-4f52-9c3f-538474fc981b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:37.847681 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3f0da9dd-f28f-4f52-9c3f-538474fc981b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:37.848280 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3f0da9dd-f28f-4f52-9c3f-538474fc981b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:37.848427 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a145cd0-e5bb-4a36-84ff-96f1890ae95a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:37.849364 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a145cd0-e5bb-4a36-84ff-96f1890ae95a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:37.849845 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a145cd0-e5bb-4a36-84ff-96f1890ae95a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:37.849973 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3f0da9dd-f28f-4f52-9c3f-538474fc981b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:37.850550 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3f0da9dd-f28f-4f52-9c3f-538474fc981b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:37.850661 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a145cd0-e5bb-4a36-84ff-96f1890ae95a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:37.851108 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a145cd0-e5bb-4a36-84ff-96f1890ae95a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:37.851378 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3f0da9dd-f28f-4f52-9c3f-538474fc981b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:37.851566 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a145cd0-e5bb-4a36-84ff-96f1890ae95a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:38.049839 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3f0da9dd-f28f-4f52-9c3f-538474fc981b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:38.054058 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9a145cd0-e5bb-4a36-84ff-96f1890ae95a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:38.058180 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3f0da9dd-f28f-4f52-9c3f-538474fc981b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.226851 Aug 24 16:48:38.058868 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 39/76] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:37 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:38.062502 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9a145cd0-e5bb-4a36-84ff-96f1890ae95a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.227345 Aug 24 16:48:38.063073 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 38/77] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:37 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:38.346612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d8bce1f4-c0a2-4c09-9580-d0b529e3f950 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:38.347341 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d8bce1f4-c0a2-4c09-9580-d0b529e3f950 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:38.353760 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8bce1f4-c0a2-4c09-9580-d0b529e3f950 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:38.354089 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8bce1f4-c0a2-4c09-9580-d0b529e3f950 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:38.354754 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8bce1f4-c0a2-4c09-9580-d0b529e3f950 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:38.355374 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8bce1f4-c0a2-4c09-9580-d0b529e3f950 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:38.356182 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8bce1f4-c0a2-4c09-9580-d0b529e3f950 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:38.356384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8bce1f4-c0a2-4c09-9580-d0b529e3f950 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:38.358270 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e250f785-9c0a-4db0-ae38-d77103ed20ab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:38.359075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e250f785-9c0a-4db0-ae38-d77103ed20ab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:38.365266 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e250f785-9c0a-4db0-ae38-d77103ed20ab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:38.366004 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e250f785-9c0a-4db0-ae38-d77103ed20ab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:38.366501 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e250f785-9c0a-4db0-ae38-d77103ed20ab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:38.367365 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e250f785-9c0a-4db0-ae38-d77103ed20ab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:38.367970 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e250f785-9c0a-4db0-ae38-d77103ed20ab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:38.368636 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e250f785-9c0a-4db0-ae38-d77103ed20ab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:38.553237 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d8bce1f4-c0a2-4c09-9580-d0b529e3f950 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:38.568243 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d8bce1f4-c0a2-4c09-9580-d0b529e3f950 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.225584 Aug 24 16:48:38.568390 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e250f785-9c0a-4db0-ae38-d77103ed20ab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:38.569069 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 40/78] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:38 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:38.576738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e250f785-9c0a-4db0-ae38-d77103ed20ab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:38.578255 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e250f785-9c0a-4db0-ae38-d77103ed20ab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:38.579373 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e250f785-9c0a-4db0-ae38-d77103ed20ab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.225669 Aug 24 16:48:38.580136 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 39/79] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:38 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:39.077780 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b7b9d8ab-2053-4437-aff1-93587ce113f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:39.078342 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b7b9d8ab-2053-4437-aff1-93587ce113f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:39.083027 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d66462c2-ae69-4031-bd2e-039ec2d4d402 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:39.084257 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d66462c2-ae69-4031-bd2e-039ec2d4d402 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:39.085055 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7b9d8ab-2053-4437-aff1-93587ce113f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:39.085539 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7b9d8ab-2053-4437-aff1-93587ce113f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:39.085971 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7b9d8ab-2053-4437-aff1-93587ce113f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:39.086656 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7b9d8ab-2053-4437-aff1-93587ce113f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:39.087211 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7b9d8ab-2053-4437-aff1-93587ce113f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:39.087524 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7b9d8ab-2053-4437-aff1-93587ce113f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:39.090789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d66462c2-ae69-4031-bd2e-039ec2d4d402 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:39.091324 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d66462c2-ae69-4031-bd2e-039ec2d4d402 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:39.091763 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d66462c2-ae69-4031-bd2e-039ec2d4d402 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:39.092471 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d66462c2-ae69-4031-bd2e-039ec2d4d402 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:39.093065 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d66462c2-ae69-4031-bd2e-039ec2d4d402 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:39.093627 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d66462c2-ae69-4031-bd2e-039ec2d4d402 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:39.288820 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b7b9d8ab-2053-4437-aff1-93587ce113f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:39.292635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d66462c2-ae69-4031-bd2e-039ec2d4d402 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:39.296844 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b7b9d8ab-2053-4437-aff1-93587ce113f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.222768 Aug 24 16:48:39.297596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 41/80] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:39 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:39.300423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d66462c2-ae69-4031-bd2e-039ec2d4d402 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.221109 Aug 24 16:48:39.301021 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 40/81] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:39 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:39.589358 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a5e6ba08-170c-4140-a6d1-0981ad752b78 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:39.589961 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a5e6ba08-170c-4140-a6d1-0981ad752b78 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:39.595959 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a5e6ba08-170c-4140-a6d1-0981ad752b78 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:39.596540 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a5e6ba08-170c-4140-a6d1-0981ad752b78 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:39.600350 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a5e6ba08-170c-4140-a6d1-0981ad752b78 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:39.600350 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a5e6ba08-170c-4140-a6d1-0981ad752b78 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:39.600350 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a5e6ba08-170c-4140-a6d1-0981ad752b78 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:39.600350 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a5e6ba08-170c-4140-a6d1-0981ad752b78 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:39.610166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fe055851-eb6c-41f7-a58d-0e128c96412a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:39.610166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fe055851-eb6c-41f7-a58d-0e128c96412a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:39.610166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe055851-eb6c-41f7-a58d-0e128c96412a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:39.610166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe055851-eb6c-41f7-a58d-0e128c96412a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:39.610847 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe055851-eb6c-41f7-a58d-0e128c96412a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:39.611616 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe055851-eb6c-41f7-a58d-0e128c96412a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:39.612244 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe055851-eb6c-41f7-a58d-0e128c96412a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:39.612795 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe055851-eb6c-41f7-a58d-0e128c96412a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:39.800251 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a5e6ba08-170c-4140-a6d1-0981ad752b78 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:39.809801 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a5e6ba08-170c-4140-a6d1-0981ad752b78 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.224672 Aug 24 16:48:39.810503 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 42/82] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:39 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:39.812951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fe055851-eb6c-41f7-a58d-0e128c96412a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:39.821606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fe055851-eb6c-41f7-a58d-0e128c96412a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:39.823709 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fe055851-eb6c-41f7-a58d-0e128c96412a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:39.824802 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fe055851-eb6c-41f7-a58d-0e128c96412a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.226847 Aug 24 16:48:39.825567 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 41/83] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:39 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:40.318552 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b03c039d-0e9d-415d-a71a-7d3b6b2e621e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:40.319177 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b03c039d-0e9d-415d-a71a-7d3b6b2e621e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:40.326307 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4a6ec407-e82d-40b8-bd43-cf0fb36ba29b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:40.328763 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4a6ec407-e82d-40b8-bd43-cf0fb36ba29b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:40.329740 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b03c039d-0e9d-415d-a71a-7d3b6b2e621e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:40.330245 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b03c039d-0e9d-415d-a71a-7d3b6b2e621e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:40.330694 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b03c039d-0e9d-415d-a71a-7d3b6b2e621e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:40.331409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b03c039d-0e9d-415d-a71a-7d3b6b2e621e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:40.331873 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b03c039d-0e9d-415d-a71a-7d3b6b2e621e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:40.332305 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b03c039d-0e9d-415d-a71a-7d3b6b2e621e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:40.340307 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a6ec407-e82d-40b8-bd43-cf0fb36ba29b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:40.341541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a6ec407-e82d-40b8-bd43-cf0fb36ba29b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:40.342143 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a6ec407-e82d-40b8-bd43-cf0fb36ba29b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:40.344276 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a6ec407-e82d-40b8-bd43-cf0fb36ba29b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:40.346859 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a6ec407-e82d-40b8-bd43-cf0fb36ba29b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:40.347540 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a6ec407-e82d-40b8-bd43-cf0fb36ba29b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:40.371158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=100 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:40.617855 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4a6ec407-e82d-40b8-bd43-cf0fb36ba29b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:40.626246 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b03c039d-0e9d-415d-a71a-7d3b6b2e621e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:40.627133 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4a6ec407-e82d-40b8-bd43-cf0fb36ba29b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.308888 Aug 24 16:48:40.635171 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b03c039d-0e9d-415d-a71a-7d3b6b2e621e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.320357 Aug 24 16:48:40.636077 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 43/84] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:40 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:40.638136 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 42/85] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:40 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:40.804584 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-d6975b0a-38be-4702-8b86-4ea7ead993e3 req-1bff850a-cae8-4cd8-9318-c69a41cd8111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2cca9b-5df9-43a4-9791-633eab746eeb", "tag": "de8a2ec3-3c1d-4c19-9833-a7a754e2b815"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:40.828869 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-d6975b0a-38be-4702-8b86-4ea7ead993e3 req-1bff850a-cae8-4cd8-9318-c69a41cd8111 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:40.829454 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d464be4d-19ed-4eaf-9dea-88023d9a7f6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:40.830080 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d464be4d-19ed-4eaf-9dea-88023d9a7f6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:40.830769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-d6975b0a-38be-4702-8b86-4ea7ead993e3 req-1bff850a-cae8-4cd8-9318-c69a41cd8111 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:40.831877 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-d6975b0a-38be-4702-8b86-4ea7ead993e3 req-1bff850a-cae8-4cd8-9318-c69a41cd8111 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:40.842544 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d464be4d-19ed-4eaf-9dea-88023d9a7f6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:40.842544 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d464be4d-19ed-4eaf-9dea-88023d9a7f6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:40.842945 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d464be4d-19ed-4eaf-9dea-88023d9a7f6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:40.843704 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d464be4d-19ed-4eaf-9dea-88023d9a7f6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:40.844171 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d464be4d-19ed-4eaf-9dea-88023d9a7f6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:40.844628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d464be4d-19ed-4eaf-9dea-88023d9a7f6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:40.857383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-d6975b0a-38be-4702-8b86-4ea7ead993e3 req-1bff850a-cae8-4cd8-9318-c69a41cd8111 service nova] Creating event network-changed:de8a2ec3-3c1d-4c19-9833-a7a754e2b815 for instance 6d2cca9b-5df9-43a4-9791-633eab746eeb on hv-cinder-85220 Aug 24 16:48:40.863318 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-d6975b0a-38be-4702-8b86-4ea7ead993e3 req-1bff850a-cae8-4cd8-9318-c69a41cd8111 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062370 Aug 24 16:48:40.866015 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 44/86] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:40.877730 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-007e1c51-34a1-46a1-874f-9a8df2736d59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:40.878896 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-007e1c51-34a1-46a1-874f-9a8df2736d59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:40.887595 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-007e1c51-34a1-46a1-874f-9a8df2736d59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:40.888945 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-007e1c51-34a1-46a1-874f-9a8df2736d59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:40.889517 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-007e1c51-34a1-46a1-874f-9a8df2736d59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:40.890459 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-007e1c51-34a1-46a1-874f-9a8df2736d59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:40.891039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-007e1c51-34a1-46a1-874f-9a8df2736d59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:40.892125 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-007e1c51-34a1-46a1-874f-9a8df2736d59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:41.244604 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d464be4d-19ed-4eaf-9dea-88023d9a7f6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:41.249260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-007e1c51-34a1-46a1-874f-9a8df2736d59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:41.252560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d464be4d-19ed-4eaf-9dea-88023d9a7f6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.426887 Aug 24 16:48:41.253397 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 43/87] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:40 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:41.257594 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-007e1c51-34a1-46a1-874f-9a8df2736d59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:41.259283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-007e1c51-34a1-46a1-874f-9a8df2736d59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:41.260587 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-007e1c51-34a1-46a1-874f-9a8df2736d59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.392205 Aug 24 16:48:41.261377 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 45/88] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:40 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:41.649236 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-52a6a1ce-7c9b-46af-866a-608329cb6348 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:41.667993 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-52a6a1ce-7c9b-46af-866a-608329cb6348 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:41.667993 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52a6a1ce-7c9b-46af-866a-608329cb6348 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:41.668215 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e71745a6-1788-4dac-87c6-c1954288ab91 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:41.668675 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52a6a1ce-7c9b-46af-866a-608329cb6348 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:41.668773 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e71745a6-1788-4dac-87c6-c1954288ab91 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:41.668846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52a6a1ce-7c9b-46af-866a-608329cb6348 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:41.668846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52a6a1ce-7c9b-46af-866a-608329cb6348 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:41.668846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52a6a1ce-7c9b-46af-866a-608329cb6348 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:41.668846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52a6a1ce-7c9b-46af-866a-608329cb6348 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:41.669123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e71745a6-1788-4dac-87c6-c1954288ab91 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:41.669123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e71745a6-1788-4dac-87c6-c1954288ab91 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:41.669123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e71745a6-1788-4dac-87c6-c1954288ab91 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:41.669123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e71745a6-1788-4dac-87c6-c1954288ab91 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:41.669367 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e71745a6-1788-4dac-87c6-c1954288ab91 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:41.669367 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e71745a6-1788-4dac-87c6-c1954288ab91 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:41.914325 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-52a6a1ce-7c9b-46af-866a-608329cb6348 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:41.918780 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e71745a6-1788-4dac-87c6-c1954288ab91 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:41.922369 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-52a6a1ce-7c9b-46af-866a-608329cb6348 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.276976 Aug 24 16:48:41.922992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 44/89] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:41 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:41.926573 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e71745a6-1788-4dac-87c6-c1954288ab91 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.273829 Aug 24 16:48:41.927121 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 46/90] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:41 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:42.154504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-30c3c84e-779a-4087-97c4-ee2f881dac47 req-4cfb1e54-9f41-4166-952a-822b35e89e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff0a3b74-291b-4381-b945-50b48a823978", "tag": "83352098-6ea5-4bd7-aa7b-077d1f804efe"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:42.167103 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-30c3c84e-779a-4087-97c4-ee2f881dac47 req-4cfb1e54-9f41-4166-952a-822b35e89e28 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.167558 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-30c3c84e-779a-4087-97c4-ee2f881dac47 req-4cfb1e54-9f41-4166-952a-822b35e89e28 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.167982 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-30c3c84e-779a-4087-97c4-ee2f881dac47 req-4cfb1e54-9f41-4166-952a-822b35e89e28 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.187262 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-30c3c84e-779a-4087-97c4-ee2f881dac47 req-4cfb1e54-9f41-4166-952a-822b35e89e28 service nova] Creating event network-changed:83352098-6ea5-4bd7-aa7b-077d1f804efe for instance ff0a3b74-291b-4381-b945-50b48a823978 on hv-cinder-85220 Aug 24 16:48:42.187775 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-30c3c84e-779a-4087-97c4-ee2f881dac47 req-4cfb1e54-9f41-4166-952a-822b35e89e28 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 16:48:42.188166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-30c3c84e-779a-4087-97c4-ee2f881dac47 req-4cfb1e54-9f41-4166-952a-822b35e89e28 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 16:48:42.189218 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97d75a7b-58d6-4aea-a21f-93109a1dc5d5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.189849 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97d75a7b-58d6-4aea-a21f-93109a1dc5d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.190272 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97d75a7b-58d6-4aea-a21f-93109a1dc5d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.190983 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97d75a7b-58d6-4aea-a21f-93109a1dc5d5 None None] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.191426 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97d75a7b-58d6-4aea-a21f-93109a1dc5d5 None None] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.191855 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97d75a7b-58d6-4aea-a21f-93109a1dc5d5 None None] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.201276 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.compute.rpcapi [None req-97d75a7b-58d6-4aea-a21f-93109a1dc5d5 None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 16:48:42.202139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97d75a7b-58d6-4aea-a21f-93109a1dc5d5 None None] Releasing lock "compute-rpcapi-router" {{(pid=127716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 16:48:42.217603 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-97d75a7b-58d6-4aea-a21f-93109a1dc5d5 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067187 Aug 24 16:48:42.220895 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 45/91] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:42.272712 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-35ebfe09-f736-4102-9d2c-cc1389722dab tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:42.273375 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-35ebfe09-f736-4102-9d2c-cc1389722dab tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:42.280207 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-35ebfe09-f736-4102-9d2c-cc1389722dab tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.280800 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-35ebfe09-f736-4102-9d2c-cc1389722dab tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.281302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-35ebfe09-f736-4102-9d2c-cc1389722dab tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.282047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-35ebfe09-f736-4102-9d2c-cc1389722dab tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.282586 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-35ebfe09-f736-4102-9d2c-cc1389722dab tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.283069 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-35ebfe09-f736-4102-9d2c-cc1389722dab tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.283902 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b19f87f9-8cdf-4f30-b9cb-6a3394b6593c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:42.284755 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b19f87f9-8cdf-4f30-b9cb-6a3394b6593c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:42.291386 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b19f87f9-8cdf-4f30-b9cb-6a3394b6593c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.291873 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b19f87f9-8cdf-4f30-b9cb-6a3394b6593c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.292312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b19f87f9-8cdf-4f30-b9cb-6a3394b6593c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.296325 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b19f87f9-8cdf-4f30-b9cb-6a3394b6593c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.296325 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b19f87f9-8cdf-4f30-b9cb-6a3394b6593c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.296325 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b19f87f9-8cdf-4f30-b9cb-6a3394b6593c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.647259 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-35ebfe09-f736-4102-9d2c-cc1389722dab tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:42.651202 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:42.656218 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-35ebfe09-f736-4102-9d2c-cc1389722dab tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.387402 Aug 24 16:48:42.663682 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b19f87f9-8cdf-4f30-b9cb-6a3394b6593c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:42.668775 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 47/92] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:42 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:42.672071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b19f87f9-8cdf-4f30-b9cb-6a3394b6593c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:42.673648 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b19f87f9-8cdf-4f30-b9cb-6a3394b6593c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:42.674808 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b19f87f9-8cdf-4f30-b9cb-6a3394b6593c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.395102 Aug 24 16:48:42.675308 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 46/93] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:42 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:42.947211 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1f9ab054-7147-4eb7-8407-4f4cf35647ee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:42.948009 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b83dc348-63ef-4f54-9b1e-08e4473d61d4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:42.948248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1f9ab054-7147-4eb7-8407-4f4cf35647ee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:42.948664 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b83dc348-63ef-4f54-9b1e-08e4473d61d4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:42.954726 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b83dc348-63ef-4f54-9b1e-08e4473d61d4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.955159 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f9ab054-7147-4eb7-8407-4f4cf35647ee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.955285 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b83dc348-63ef-4f54-9b1e-08e4473d61d4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.955628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b83dc348-63ef-4f54-9b1e-08e4473d61d4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.955721 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f9ab054-7147-4eb7-8407-4f4cf35647ee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.956056 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f9ab054-7147-4eb7-8407-4f4cf35647ee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.956315 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b83dc348-63ef-4f54-9b1e-08e4473d61d4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.956776 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f9ab054-7147-4eb7-8407-4f4cf35647ee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.956871 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b83dc348-63ef-4f54-9b1e-08e4473d61d4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.957204 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b83dc348-63ef-4f54-9b1e-08e4473d61d4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.957294 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f9ab054-7147-4eb7-8407-4f4cf35647ee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.957654 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f9ab054-7147-4eb7-8407-4f4cf35647ee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:43.144807 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b83dc348-63ef-4f54-9b1e-08e4473d61d4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:43.152880 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b83dc348-63ef-4f54-9b1e-08e4473d61d4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.209274 Aug 24 16:48:43.153033 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1f9ab054-7147-4eb7-8407-4f4cf35647ee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:43.153497 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 47/94] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:42 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:43.162014 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1f9ab054-7147-4eb7-8407-4f4cf35647ee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.218735 Aug 24 16:48:43.167596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 48/95] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:42 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:43.676838 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f2a6f3f4-5307-4243-a872-10f08d8a2f4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:43.677456 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f2a6f3f4-5307-4243-a872-10f08d8a2f4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:43.685159 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2a6f3f4-5307-4243-a872-10f08d8a2f4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:43.685637 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2a6f3f4-5307-4243-a872-10f08d8a2f4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:43.686067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2a6f3f4-5307-4243-a872-10f08d8a2f4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:43.686749 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2a6f3f4-5307-4243-a872-10f08d8a2f4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:43.687199 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2a6f3f4-5307-4243-a872-10f08d8a2f4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:43.687618 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2a6f3f4-5307-4243-a872-10f08d8a2f4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:43.697323 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6c05ff9e-f606-4a43-90de-00184f969613 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:43.697972 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6c05ff9e-f606-4a43-90de-00184f969613 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:43.703754 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6c05ff9e-f606-4a43-90de-00184f969613 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:43.704230 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6c05ff9e-f606-4a43-90de-00184f969613 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:43.704689 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6c05ff9e-f606-4a43-90de-00184f969613 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:43.705366 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6c05ff9e-f606-4a43-90de-00184f969613 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:43.705820 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6c05ff9e-f606-4a43-90de-00184f969613 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:43.706257 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6c05ff9e-f606-4a43-90de-00184f969613 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:43.878101 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f2a6f3f4-5307-4243-a872-10f08d8a2f4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:43.887809 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f2a6f3f4-5307-4243-a872-10f08d8a2f4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.214342 Aug 24 16:48:43.888857 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 48/96] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:43 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:43.889453 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6c05ff9e-f606-4a43-90de-00184f969613 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:43.898223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6c05ff9e-f606-4a43-90de-00184f969613 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:43.899859 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6c05ff9e-f606-4a43-90de-00184f969613 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:43.901162 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6c05ff9e-f606-4a43-90de-00184f969613 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.207658 Aug 24 16:48:43.901721 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 49/97] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:43 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:44.173061 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-42e7a63c-d896-4251-b07c-f51075089fe9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:44.173694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-42e7a63c-d896-4251-b07c-f51075089fe9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:44.179566 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-42e7a63c-d896-4251-b07c-f51075089fe9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:44.180063 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-42e7a63c-d896-4251-b07c-f51075089fe9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:44.180519 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-42e7a63c-d896-4251-b07c-f51075089fe9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:44.182588 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-42e7a63c-d896-4251-b07c-f51075089fe9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:44.182588 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-42e7a63c-d896-4251-b07c-f51075089fe9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:44.182930 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-42e7a63c-d896-4251-b07c-f51075089fe9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:44.186646 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4788d45f-d962-4c29-a021-fba84ac3e877 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:44.187263 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4788d45f-d962-4c29-a021-fba84ac3e877 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:44.193223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4788d45f-d962-4c29-a021-fba84ac3e877 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:44.193707 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4788d45f-d962-4c29-a021-fba84ac3e877 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:44.194142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4788d45f-d962-4c29-a021-fba84ac3e877 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:44.194825 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4788d45f-d962-4c29-a021-fba84ac3e877 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:44.195280 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4788d45f-d962-4c29-a021-fba84ac3e877 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:44.195703 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4788d45f-d962-4c29-a021-fba84ac3e877 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:44.378849 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-42e7a63c-d896-4251-b07c-f51075089fe9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:44.386491 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-42e7a63c-d896-4251-b07c-f51075089fe9 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.217226 Aug 24 16:48:44.387228 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 49/98] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:44 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:44.389859 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4788d45f-d962-4c29-a021-fba84ac3e877 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:44.397514 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4788d45f-d962-4c29-a021-fba84ac3e877 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.214744 Aug 24 16:48:44.398067 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 50/99] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:44 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:44.909623 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1e30df86-2461-441a-b56f-68d21134f2de tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:44.910237 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1e30df86-2461-441a-b56f-68d21134f2de tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:44.916851 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e30df86-2461-441a-b56f-68d21134f2de tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:44.917330 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e30df86-2461-441a-b56f-68d21134f2de tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:44.917765 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e30df86-2461-441a-b56f-68d21134f2de tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:44.918451 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e30df86-2461-441a-b56f-68d21134f2de tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:44.918900 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e30df86-2461-441a-b56f-68d21134f2de tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:44.919324 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e30df86-2461-441a-b56f-68d21134f2de tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:44.924538 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ee21235e-9d54-4cbb-ad3f-678c2744e6c5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:44.925156 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ee21235e-9d54-4cbb-ad3f-678c2744e6c5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:44.930947 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee21235e-9d54-4cbb-ad3f-678c2744e6c5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:44.931434 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee21235e-9d54-4cbb-ad3f-678c2744e6c5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:44.932371 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee21235e-9d54-4cbb-ad3f-678c2744e6c5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:44.933084 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee21235e-9d54-4cbb-ad3f-678c2744e6c5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:44.933544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee21235e-9d54-4cbb-ad3f-678c2744e6c5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:44.933969 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee21235e-9d54-4cbb-ad3f-678c2744e6c5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:45.112550 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1e30df86-2461-441a-b56f-68d21134f2de tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:45.115629 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ee21235e-9d54-4cbb-ad3f-678c2744e6c5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:45.120967 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1e30df86-2461-441a-b56f-68d21134f2de tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.215055 Aug 24 16:48:45.122006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 50/100] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:44 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:45.124122 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ee21235e-9d54-4cbb-ad3f-678c2744e6c5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:45.125665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ee21235e-9d54-4cbb-ad3f-678c2744e6c5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:45.126774 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ee21235e-9d54-4cbb-ad3f-678c2744e6c5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.206431 Aug 24 16:48:45.127323 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 51/101] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:44 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:45.406810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-caf64432-f5d2-478e-9bf3-aca9ef99c617 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:45.407449 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-caf64432-f5d2-478e-9bf3-aca9ef99c617 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:45.413591 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-caf64432-f5d2-478e-9bf3-aca9ef99c617 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:45.414062 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-caf64432-f5d2-478e-9bf3-aca9ef99c617 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:45.414495 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-caf64432-f5d2-478e-9bf3-aca9ef99c617 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:45.415355 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-caf64432-f5d2-478e-9bf3-aca9ef99c617 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:45.415777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-caf64432-f5d2-478e-9bf3-aca9ef99c617 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:45.416202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-caf64432-f5d2-478e-9bf3-aca9ef99c617 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:45.418831 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-18389882-80ad-4753-ba95-3a56f8790f83 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:45.419439 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-18389882-80ad-4753-ba95-3a56f8790f83 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:45.425463 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-18389882-80ad-4753-ba95-3a56f8790f83 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:45.425948 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-18389882-80ad-4753-ba95-3a56f8790f83 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:45.426383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-18389882-80ad-4753-ba95-3a56f8790f83 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:45.427066 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-18389882-80ad-4753-ba95-3a56f8790f83 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:45.427518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-18389882-80ad-4753-ba95-3a56f8790f83 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:45.427941 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-18389882-80ad-4753-ba95-3a56f8790f83 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:45.605048 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-caf64432-f5d2-478e-9bf3-aca9ef99c617 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:45.613069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-caf64432-f5d2-478e-9bf3-aca9ef99c617 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.210075 Aug 24 16:48:45.613804 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 51/102] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:45 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:45.622309 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-18389882-80ad-4753-ba95-3a56f8790f83 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:45.629864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-18389882-80ad-4753-ba95-3a56f8790f83 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.214811 Aug 24 16:48:45.630425 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 52/103] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:45 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:46.142004 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-89e832ea-721f-4d62-966f-cea8571c94dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:46.142533 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-89e832ea-721f-4d62-966f-cea8571c94dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:46.148914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89e832ea-721f-4d62-966f-cea8571c94dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:46.149061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8dfc98b9-4a74-455b-9a9d-99603cbf3a9f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:46.149492 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89e832ea-721f-4d62-966f-cea8571c94dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:46.149610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8dfc98b9-4a74-455b-9a9d-99603cbf3a9f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:46.149816 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89e832ea-721f-4d62-966f-cea8571c94dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:46.151079 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89e832ea-721f-4d62-966f-cea8571c94dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:46.151532 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89e832ea-721f-4d62-966f-cea8571c94dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:46.151954 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89e832ea-721f-4d62-966f-cea8571c94dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:46.156123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8dfc98b9-4a74-455b-9a9d-99603cbf3a9f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:46.156671 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8dfc98b9-4a74-455b-9a9d-99603cbf3a9f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:46.157107 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8dfc98b9-4a74-455b-9a9d-99603cbf3a9f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:46.157791 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8dfc98b9-4a74-455b-9a9d-99603cbf3a9f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:46.158306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8dfc98b9-4a74-455b-9a9d-99603cbf3a9f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:46.158731 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8dfc98b9-4a74-455b-9a9d-99603cbf3a9f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:46.407540 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-89e832ea-721f-4d62-966f-cea8571c94dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:46.410817 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8dfc98b9-4a74-455b-9a9d-99603cbf3a9f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:46.415274 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-89e832ea-721f-4d62-966f-cea8571c94dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.277178 Aug 24 16:48:46.415935 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 52/104] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:46 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:46.418958 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8dfc98b9-4a74-455b-9a9d-99603cbf3a9f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:46.420469 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8dfc98b9-4a74-455b-9a9d-99603cbf3a9f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:46.421598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8dfc98b9-4a74-455b-9a9d-99603cbf3a9f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.276452 Aug 24 16:48:46.422144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 53/105] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:46 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:46.633605 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-158489ab-e320-49fb-af9c-bd43c9e0e244 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:46.634219 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-158489ab-e320-49fb-af9c-bd43c9e0e244 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:46.640077 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-158489ab-e320-49fb-af9c-bd43c9e0e244 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:46.642691 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-158489ab-e320-49fb-af9c-bd43c9e0e244 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:46.642691 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-158489ab-e320-49fb-af9c-bd43c9e0e244 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:46.642691 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-158489ab-e320-49fb-af9c-bd43c9e0e244 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:46.642691 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-158489ab-e320-49fb-af9c-bd43c9e0e244 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:46.643139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-158489ab-e320-49fb-af9c-bd43c9e0e244 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:46.649368 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e695dda1-8db0-4b1d-979e-20d3d35ea5dd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:46.649974 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e695dda1-8db0-4b1d-979e-20d3d35ea5dd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:46.656365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e695dda1-8db0-4b1d-979e-20d3d35ea5dd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:46.656818 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e695dda1-8db0-4b1d-979e-20d3d35ea5dd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:46.657243 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e695dda1-8db0-4b1d-979e-20d3d35ea5dd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:46.657923 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e695dda1-8db0-4b1d-979e-20d3d35ea5dd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:46.658381 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e695dda1-8db0-4b1d-979e-20d3d35ea5dd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:46.658834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e695dda1-8db0-4b1d-979e-20d3d35ea5dd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:46.842806 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-158489ab-e320-49fb-af9c-bd43c9e0e244 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:46.849746 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e695dda1-8db0-4b1d-979e-20d3d35ea5dd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:46.850430 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-158489ab-e320-49fb-af9c-bd43c9e0e244 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.220696 Aug 24 16:48:46.851002 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 53/106] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:46 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:46.857943 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e695dda1-8db0-4b1d-979e-20d3d35ea5dd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.212392 Aug 24 16:48:46.858505 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 54/107] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:46 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:47.435777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b1e4e767-3d20-4156-b7ca-04ae5a7bd999 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:47.436318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b1e4e767-3d20-4156-b7ca-04ae5a7bd999 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:47.442416 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1e4e767-3d20-4156-b7ca-04ae5a7bd999 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.442894 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1e4e767-3d20-4156-b7ca-04ae5a7bd999 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.443325 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1e4e767-3d20-4156-b7ca-04ae5a7bd999 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.444007 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1e4e767-3d20-4156-b7ca-04ae5a7bd999 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.444099 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8a644719-9e03-4150-ac15-0339464f4fc6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:47.444505 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1e4e767-3d20-4156-b7ca-04ae5a7bd999 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.444680 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8a644719-9e03-4150-ac15-0339464f4fc6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:47.444887 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1e4e767-3d20-4156-b7ca-04ae5a7bd999 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.451034 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a644719-9e03-4150-ac15-0339464f4fc6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.451516 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a644719-9e03-4150-ac15-0339464f4fc6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.451960 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a644719-9e03-4150-ac15-0339464f4fc6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.452675 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a644719-9e03-4150-ac15-0339464f4fc6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.453132 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a644719-9e03-4150-ac15-0339464f4fc6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.453555 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a644719-9e03-4150-ac15-0339464f4fc6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.651041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b1e4e767-3d20-4156-b7ca-04ae5a7bd999 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:47.654338 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8a644719-9e03-4150-ac15-0339464f4fc6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:47.659918 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b1e4e767-3d20-4156-b7ca-04ae5a7bd999 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.227567 Aug 24 16:48:47.660843 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 54/108] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:47 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:47.663898 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8a644719-9e03-4150-ac15-0339464f4fc6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:47.665625 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8a644719-9e03-4150-ac15-0339464f4fc6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:47.667976 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8a644719-9e03-4150-ac15-0339464f4fc6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.227923 Aug 24 16:48:47.672438 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 55/109] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:47 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:47.871322 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e8ac19eb-bb24-44cd-95b3-26f124e66625 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:47.871990 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e8ac19eb-bb24-44cd-95b3-26f124e66625 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:47.878082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8ac19eb-bb24-44cd-95b3-26f124e66625 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.878729 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8ac19eb-bb24-44cd-95b3-26f124e66625 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.878831 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-cd07a76a-4a43-44ec-b6f5-077679f7ce28 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:47.879202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8ac19eb-bb24-44cd-95b3-26f124e66625 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.879525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-cd07a76a-4a43-44ec-b6f5-077679f7ce28 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:47.879893 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8ac19eb-bb24-44cd-95b3-26f124e66625 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.880354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8ac19eb-bb24-44cd-95b3-26f124e66625 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.880939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8ac19eb-bb24-44cd-95b3-26f124e66625 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.885346 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cd07a76a-4a43-44ec-b6f5-077679f7ce28 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.885828 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cd07a76a-4a43-44ec-b6f5-077679f7ce28 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.886263 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cd07a76a-4a43-44ec-b6f5-077679f7ce28 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.886944 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cd07a76a-4a43-44ec-b6f5-077679f7ce28 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.887430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cd07a76a-4a43-44ec-b6f5-077679f7ce28 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.887850 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cd07a76a-4a43-44ec-b6f5-077679f7ce28 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:48.071098 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cd07a76a-4a43-44ec-b6f5-077679f7ce28 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:48.074143 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e8ac19eb-bb24-44cd-95b3-26f124e66625 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:48.079894 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-cd07a76a-4a43-44ec-b6f5-077679f7ce28 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.204670 Aug 24 16:48:48.080505 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 56/110] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:47 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:48.082691 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e8ac19eb-bb24-44cd-95b3-26f124e66625 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.215618 Aug 24 16:48:48.083252 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 55/111] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:47 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:48.681878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-421ac83e-df3e-4e1d-abff-9ca12a2a70bf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:48.682491 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-421ac83e-df3e-4e1d-abff-9ca12a2a70bf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:48.690388 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-421ac83e-df3e-4e1d-abff-9ca12a2a70bf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:48.690917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-421ac83e-df3e-4e1d-abff-9ca12a2a70bf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:48.691059 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d7cbf29c-138e-431a-a904-bbfc5a869349 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:48.691510 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-421ac83e-df3e-4e1d-abff-9ca12a2a70bf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:48.692032 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-421ac83e-df3e-4e1d-abff-9ca12a2a70bf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:48.692262 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d7cbf29c-138e-431a-a904-bbfc5a869349 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:48.692517 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-421ac83e-df3e-4e1d-abff-9ca12a2a70bf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:48.692940 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-421ac83e-df3e-4e1d-abff-9ca12a2a70bf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:48.700702 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7cbf29c-138e-431a-a904-bbfc5a869349 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:48.701196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7cbf29c-138e-431a-a904-bbfc5a869349 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:48.701632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7cbf29c-138e-431a-a904-bbfc5a869349 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:48.702331 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7cbf29c-138e-431a-a904-bbfc5a869349 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:48.702778 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7cbf29c-138e-431a-a904-bbfc5a869349 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:48.703199 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7cbf29c-138e-431a-a904-bbfc5a869349 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:48.883505 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-421ac83e-df3e-4e1d-abff-9ca12a2a70bf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:48.891517 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d7cbf29c-138e-431a-a904-bbfc5a869349 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:48.894800 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-421ac83e-df3e-4e1d-abff-9ca12a2a70bf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.217182 Aug 24 16:48:48.897617 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 57/112] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:48 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:48.914254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d7cbf29c-138e-431a-a904-bbfc5a869349 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:48.916357 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d7cbf29c-138e-431a-a904-bbfc5a869349 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:48.917487 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d7cbf29c-138e-431a-a904-bbfc5a869349 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.230245 Aug 24 16:48:48.918042 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 56/113] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:48 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:49.100800 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ab597eea-7b56-4831-9fdc-727143610542 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:49.101489 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ab597eea-7b56-4831-9fdc-727143610542 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:49.105614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c7c624e8-bb6b-4bcb-9dc5-51cf3501d25d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:49.106321 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c7c624e8-bb6b-4bcb-9dc5-51cf3501d25d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:49.107990 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab597eea-7b56-4831-9fdc-727143610542 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:49.108512 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab597eea-7b56-4831-9fdc-727143610542 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:49.108960 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab597eea-7b56-4831-9fdc-727143610542 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:49.109647 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab597eea-7b56-4831-9fdc-727143610542 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:49.110112 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab597eea-7b56-4831-9fdc-727143610542 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:49.110523 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab597eea-7b56-4831-9fdc-727143610542 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:49.112294 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7c624e8-bb6b-4bcb-9dc5-51cf3501d25d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:49.112812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7c624e8-bb6b-4bcb-9dc5-51cf3501d25d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:49.113255 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7c624e8-bb6b-4bcb-9dc5-51cf3501d25d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:49.113945 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7c624e8-bb6b-4bcb-9dc5-51cf3501d25d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:49.114405 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7c624e8-bb6b-4bcb-9dc5-51cf3501d25d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:49.114831 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7c624e8-bb6b-4bcb-9dc5-51cf3501d25d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:49.310872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ab597eea-7b56-4831-9fdc-727143610542 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:49.316737 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c7c624e8-bb6b-4bcb-9dc5-51cf3501d25d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:49.319102 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ab597eea-7b56-4831-9fdc-727143610542 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.222463 Aug 24 16:48:49.319714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 58/114] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:49 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:49.322001 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c7c624e8-bb6b-4bcb-9dc5-51cf3501d25d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.223070 Aug 24 16:48:49.322570 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 57/115] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:49 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:49.915212 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-66004d61-1865-4621-ab67-83cee39d530d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:49.915829 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-66004d61-1865-4621-ab67-83cee39d530d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:49.922096 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66004d61-1865-4621-ab67-83cee39d530d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:49.922582 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66004d61-1865-4621-ab67-83cee39d530d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:49.923020 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66004d61-1865-4621-ab67-83cee39d530d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:49.923707 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66004d61-1865-4621-ab67-83cee39d530d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:49.924184 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66004d61-1865-4621-ab67-83cee39d530d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:49.924637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66004d61-1865-4621-ab67-83cee39d530d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:49.941542 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-eac21a70-28d8-4bd8-9ac1-e852be28ebe5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:49.942299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-eac21a70-28d8-4bd8-9ac1-e852be28ebe5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:49.949002 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eac21a70-28d8-4bd8-9ac1-e852be28ebe5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:49.949711 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eac21a70-28d8-4bd8-9ac1-e852be28ebe5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:49.950366 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eac21a70-28d8-4bd8-9ac1-e852be28ebe5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:49.951522 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eac21a70-28d8-4bd8-9ac1-e852be28ebe5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:49.952418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eac21a70-28d8-4bd8-9ac1-e852be28ebe5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:49.953152 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eac21a70-28d8-4bd8-9ac1-e852be28ebe5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:50.106548 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-66004d61-1865-4621-ab67-83cee39d530d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:50.114336 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-66004d61-1865-4621-ab67-83cee39d530d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.203077 Aug 24 16:48:50.114907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 59/116] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:49 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:50.131772 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eac21a70-28d8-4bd8-9ac1-e852be28ebe5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:50.139719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eac21a70-28d8-4bd8-9ac1-e852be28ebe5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:50.141229 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eac21a70-28d8-4bd8-9ac1-e852be28ebe5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:50.142315 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-eac21a70-28d8-4bd8-9ac1-e852be28ebe5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.206096 Aug 24 16:48:50.142865 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 58/117] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:49 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:50.339468 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e36694f9-db21-44a0-ad77-c50bc79d3601 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:50.339999 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e36694f9-db21-44a0-ad77-c50bc79d3601 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:50.343632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-26e9fde4-64b0-4735-84cf-93dc94bd0c13 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:50.344248 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-26e9fde4-64b0-4735-84cf-93dc94bd0c13 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:50.346223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e36694f9-db21-44a0-ad77-c50bc79d3601 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:50.346717 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e36694f9-db21-44a0-ad77-c50bc79d3601 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:50.347157 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e36694f9-db21-44a0-ad77-c50bc79d3601 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:50.347847 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e36694f9-db21-44a0-ad77-c50bc79d3601 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:50.348305 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e36694f9-db21-44a0-ad77-c50bc79d3601 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:50.348761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e36694f9-db21-44a0-ad77-c50bc79d3601 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:50.350137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26e9fde4-64b0-4735-84cf-93dc94bd0c13 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:50.350610 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26e9fde4-64b0-4735-84cf-93dc94bd0c13 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:50.351049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26e9fde4-64b0-4735-84cf-93dc94bd0c13 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:50.351747 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26e9fde4-64b0-4735-84cf-93dc94bd0c13 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:50.352208 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26e9fde4-64b0-4735-84cf-93dc94bd0c13 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:50.352652 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26e9fde4-64b0-4735-84cf-93dc94bd0c13 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:50.367425 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=100 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:50.538133 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e36694f9-db21-44a0-ad77-c50bc79d3601 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:50.546098 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e36694f9-db21-44a0-ad77-c50bc79d3601 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.210592 Aug 24 16:48:50.546679 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 60/118] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:50 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:50.547463 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-26e9fde4-64b0-4735-84cf-93dc94bd0c13 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:50.555265 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-26e9fde4-64b0-4735-84cf-93dc94bd0c13 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.215496 Aug 24 16:48:50.555822 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 59/119] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:50 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:51.135378 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e973f1da-07d9-4025-8f54-e74c6d627cd5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:51.140800 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e973f1da-07d9-4025-8f54-e74c6d627cd5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:51.142223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e973f1da-07d9-4025-8f54-e74c6d627cd5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:51.142705 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e973f1da-07d9-4025-8f54-e74c6d627cd5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:51.143139 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e973f1da-07d9-4025-8f54-e74c6d627cd5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:51.143830 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e973f1da-07d9-4025-8f54-e74c6d627cd5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:51.144283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e973f1da-07d9-4025-8f54-e74c6d627cd5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:51.144751 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e973f1da-07d9-4025-8f54-e74c6d627cd5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:51.165132 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0208578c-17af-4a40-8d6e-f2f45e7915c3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:51.166329 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0208578c-17af-4a40-8d6e-f2f45e7915c3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:51.183259 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0208578c-17af-4a40-8d6e-f2f45e7915c3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:51.183259 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0208578c-17af-4a40-8d6e-f2f45e7915c3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:51.183259 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0208578c-17af-4a40-8d6e-f2f45e7915c3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:51.183259 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0208578c-17af-4a40-8d6e-f2f45e7915c3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:51.183531 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0208578c-17af-4a40-8d6e-f2f45e7915c3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:51.183531 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0208578c-17af-4a40-8d6e-f2f45e7915c3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:51.348832 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e973f1da-07d9-4025-8f54-e74c6d627cd5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:51.353140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0208578c-17af-4a40-8d6e-f2f45e7915c3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:51.356994 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e973f1da-07d9-4025-8f54-e74c6d627cd5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.225826 Aug 24 16:48:51.357572 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 61/120] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:51 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:51.361277 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0208578c-17af-4a40-8d6e-f2f45e7915c3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:51.362771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0208578c-17af-4a40-8d6e-f2f45e7915c3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:51.365393 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0208578c-17af-4a40-8d6e-f2f45e7915c3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.202757 Aug 24 16:48:51.365393 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 60/121] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:51 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:51.567039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8f5228b6-e8f0-4f41-801d-40a1f2e573e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:51.567679 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8f5228b6-e8f0-4f41-801d-40a1f2e573e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:51.574918 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f5228b6-e8f0-4f41-801d-40a1f2e573e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:51.575408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f5228b6-e8f0-4f41-801d-40a1f2e573e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:51.579338 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f5228b6-e8f0-4f41-801d-40a1f2e573e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:51.579338 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f5228b6-e8f0-4f41-801d-40a1f2e573e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:51.579338 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f5228b6-e8f0-4f41-801d-40a1f2e573e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:51.579338 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f5228b6-e8f0-4f41-801d-40a1f2e573e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:51.579613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6e388d3a-ea8f-4137-87d8-7e3820967dbe tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:51.579613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6e388d3a-ea8f-4137-87d8-7e3820967dbe tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:51.586463 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e388d3a-ea8f-4137-87d8-7e3820967dbe tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:51.586735 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e388d3a-ea8f-4137-87d8-7e3820967dbe tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:51.587333 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e388d3a-ea8f-4137-87d8-7e3820967dbe tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:51.588062 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e388d3a-ea8f-4137-87d8-7e3820967dbe tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:51.588611 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e388d3a-ea8f-4137-87d8-7e3820967dbe tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:51.589046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e388d3a-ea8f-4137-87d8-7e3820967dbe tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:51.775892 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8f5228b6-e8f0-4f41-801d-40a1f2e573e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:51.779931 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6e388d3a-ea8f-4137-87d8-7e3820967dbe tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:51.783630 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8f5228b6-e8f0-4f41-801d-40a1f2e573e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.220587 Aug 24 16:48:51.788439 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 62/122] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:51 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:51.788569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6e388d3a-ea8f-4137-87d8-7e3820967dbe tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.214389 Aug 24 16:48:51.788569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 61/123] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:51 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:52.378243 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9cc8bbfe-b0c5-4b79-8016-941db45953ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:52.378860 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9cc8bbfe-b0c5-4b79-8016-941db45953ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:52.385472 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9cc8bbfe-b0c5-4b79-8016-941db45953ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:52.385962 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9cc8bbfe-b0c5-4b79-8016-941db45953ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:52.386398 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9cc8bbfe-b0c5-4b79-8016-941db45953ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:52.386719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-57a5a599-2467-4195-b894-47e9a2198fcb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:52.387135 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9cc8bbfe-b0c5-4b79-8016-941db45953ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:52.387332 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-57a5a599-2467-4195-b894-47e9a2198fcb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:52.387523 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9cc8bbfe-b0c5-4b79-8016-941db45953ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:52.387944 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9cc8bbfe-b0c5-4b79-8016-941db45953ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:52.389193 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:52.393923 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57a5a599-2467-4195-b894-47e9a2198fcb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:52.394390 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57a5a599-2467-4195-b894-47e9a2198fcb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:52.394818 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57a5a599-2467-4195-b894-47e9a2198fcb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:52.395578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57a5a599-2467-4195-b894-47e9a2198fcb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:52.396028 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57a5a599-2467-4195-b894-47e9a2198fcb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:52.396471 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57a5a599-2467-4195-b894-47e9a2198fcb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:52.578523 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-57a5a599-2467-4195-b894-47e9a2198fcb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:52.581192 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9cc8bbfe-b0c5-4b79-8016-941db45953ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:52.586906 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-57a5a599-2467-4195-b894-47e9a2198fcb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:52.588481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-57a5a599-2467-4195-b894-47e9a2198fcb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:52.589260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9cc8bbfe-b0c5-4b79-8016-941db45953ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.214838 Aug 24 16:48:52.589583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-57a5a599-2467-4195-b894-47e9a2198fcb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.207296 Aug 24 16:48:52.589831 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 63/124] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:52 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:52.590131 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 62/125] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:52 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:52.804135 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c4ae6e95-7ed1-41e7-9fee-5a6bace4c0fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:52.804802 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c4ae6e95-7ed1-41e7-9fee-5a6bace4c0fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:52.806769 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-573a9a8a-4394-4547-9ac9-07e1c21435c1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:52.807381 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-573a9a8a-4394-4547-9ac9-07e1c21435c1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:52.811221 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c4ae6e95-7ed1-41e7-9fee-5a6bace4c0fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:52.811713 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c4ae6e95-7ed1-41e7-9fee-5a6bace4c0fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:52.812150 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c4ae6e95-7ed1-41e7-9fee-5a6bace4c0fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:52.812868 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c4ae6e95-7ed1-41e7-9fee-5a6bace4c0fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:52.813194 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-573a9a8a-4394-4547-9ac9-07e1c21435c1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:52.813309 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c4ae6e95-7ed1-41e7-9fee-5a6bace4c0fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:52.813672 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-573a9a8a-4394-4547-9ac9-07e1c21435c1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:52.814102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-573a9a8a-4394-4547-9ac9-07e1c21435c1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:52.814338 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c4ae6e95-7ed1-41e7-9fee-5a6bace4c0fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:52.814781 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-573a9a8a-4394-4547-9ac9-07e1c21435c1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:52.815228 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-573a9a8a-4394-4547-9ac9-07e1c21435c1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:52.815653 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-573a9a8a-4394-4547-9ac9-07e1c21435c1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:52.832601 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:53.006622 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c4ae6e95-7ed1-41e7-9fee-5a6bace4c0fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:53.009615 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-573a9a8a-4394-4547-9ac9-07e1c21435c1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:53.014296 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c4ae6e95-7ed1-41e7-9fee-5a6bace4c0fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.213936 Aug 24 16:48:53.014865 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 64/126] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:52 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:53.017305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-573a9a8a-4394-4547-9ac9-07e1c21435c1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.214276 Aug 24 16:48:53.017954 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 63/127] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:52 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:53.610481 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-613c8cce-5773-4e84-bded-4e8840ce5ccb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:53.611097 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-613c8cce-5773-4e84-bded-4e8840ce5ccb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:53.611340 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-361cf77b-b195-4200-a88e-74dec8389a7f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:53.612070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-361cf77b-b195-4200-a88e-74dec8389a7f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:53.617185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-613c8cce-5773-4e84-bded-4e8840ce5ccb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:53.617676 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-613c8cce-5773-4e84-bded-4e8840ce5ccb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:53.617891 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-361cf77b-b195-4200-a88e-74dec8389a7f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:53.618111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-613c8cce-5773-4e84-bded-4e8840ce5ccb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:53.618612 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-361cf77b-b195-4200-a88e-74dec8389a7f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:53.619624 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-361cf77b-b195-4200-a88e-74dec8389a7f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:53.619726 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-613c8cce-5773-4e84-bded-4e8840ce5ccb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:53.620188 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-613c8cce-5773-4e84-bded-4e8840ce5ccb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:53.620309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-361cf77b-b195-4200-a88e-74dec8389a7f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:53.620640 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-613c8cce-5773-4e84-bded-4e8840ce5ccb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:53.620813 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-361cf77b-b195-4200-a88e-74dec8389a7f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:53.621218 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-361cf77b-b195-4200-a88e-74dec8389a7f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:53.973718 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-613c8cce-5773-4e84-bded-4e8840ce5ccb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:53.978686 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-361cf77b-b195-4200-a88e-74dec8389a7f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:53.982013 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-613c8cce-5773-4e84-bded-4e8840ce5ccb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.375735 Aug 24 16:48:53.982580 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 65/128] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:53 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:53.986691 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-361cf77b-b195-4200-a88e-74dec8389a7f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:53.988182 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-361cf77b-b195-4200-a88e-74dec8389a7f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:53.989356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-361cf77b-b195-4200-a88e-74dec8389a7f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.381901 Aug 24 16:48:53.989907 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 64/129] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:53 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:54.034727 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0da4af37-5984-494a-ada8-5e30285435aa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:54.035330 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0da4af37-5984-494a-ada8-5e30285435aa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:54.036516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c951df21-e838-48c2-84ff-ccf528fa668f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:54.037135 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c951df21-e838-48c2-84ff-ccf528fa668f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:54.041843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0da4af37-5984-494a-ada8-5e30285435aa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:54.042320 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0da4af37-5984-494a-ada8-5e30285435aa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:54.042744 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0da4af37-5984-494a-ada8-5e30285435aa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:54.043417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0da4af37-5984-494a-ada8-5e30285435aa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:54.043521 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c951df21-e838-48c2-84ff-ccf528fa668f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:54.043861 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0da4af37-5984-494a-ada8-5e30285435aa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:54.043963 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c951df21-e838-48c2-84ff-ccf528fa668f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:54.044275 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0da4af37-5984-494a-ada8-5e30285435aa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:54.044367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c951df21-e838-48c2-84ff-ccf528fa668f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:54.045108 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c951df21-e838-48c2-84ff-ccf528fa668f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:54.045503 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c951df21-e838-48c2-84ff-ccf528fa668f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:54.045923 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c951df21-e838-48c2-84ff-ccf528fa668f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:54.238947 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0da4af37-5984-494a-ada8-5e30285435aa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:54.242268 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c951df21-e838-48c2-84ff-ccf528fa668f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:54.247643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0da4af37-5984-494a-ada8-5e30285435aa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.216584 Aug 24 16:48:54.248288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 66/130] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:54 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:54.251017 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c951df21-e838-48c2-84ff-ccf528fa668f tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.218155 Aug 24 16:48:54.251597 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 65/131] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:54 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:55.002256 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-20d0e7ed-cd1a-46be-bfb9-f609effa1f91 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:55.002868 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-20d0e7ed-cd1a-46be-bfb9-f609effa1f91 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:55.008998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20d0e7ed-cd1a-46be-bfb9-f609effa1f91 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:55.009995 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20d0e7ed-cd1a-46be-bfb9-f609effa1f91 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:55.010430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20d0e7ed-cd1a-46be-bfb9-f609effa1f91 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:55.011146 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20d0e7ed-cd1a-46be-bfb9-f609effa1f91 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:55.011305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f999d242-4ba1-4c03-a650-cc011f1284b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:55.011681 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20d0e7ed-cd1a-46be-bfb9-f609effa1f91 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:55.011981 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f999d242-4ba1-4c03-a650-cc011f1284b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:55.012076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20d0e7ed-cd1a-46be-bfb9-f609effa1f91 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:55.017904 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f999d242-4ba1-4c03-a650-cc011f1284b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:55.018379 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f999d242-4ba1-4c03-a650-cc011f1284b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:55.018808 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f999d242-4ba1-4c03-a650-cc011f1284b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:55.019496 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f999d242-4ba1-4c03-a650-cc011f1284b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:55.019977 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f999d242-4ba1-4c03-a650-cc011f1284b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:55.020395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f999d242-4ba1-4c03-a650-cc011f1284b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:55.201910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-20d0e7ed-cd1a-46be-bfb9-f609effa1f91 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:55.205948 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f999d242-4ba1-4c03-a650-cc011f1284b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:55.209817 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-20d0e7ed-cd1a-46be-bfb9-f609effa1f91 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.211353 Aug 24 16:48:55.210718 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 67/132] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:54 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:55.214100 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f999d242-4ba1-4c03-a650-cc011f1284b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:55.215632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f999d242-4ba1-4c03-a650-cc011f1284b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:55.216761 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f999d242-4ba1-4c03-a650-cc011f1284b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.209722 Aug 24 16:48:55.217312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 66/133] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:55 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:55.268584 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e1e54399-4c52-41fa-a2b3-44abea13b633 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:55.269324 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e1e54399-4c52-41fa-a2b3-44abea13b633 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:55.271336 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-eb2bd85a-8bee-4b7a-b197-5998a6365d4a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:55.271975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-eb2bd85a-8bee-4b7a-b197-5998a6365d4a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:55.275315 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e1e54399-4c52-41fa-a2b3-44abea13b633 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:55.275809 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e1e54399-4c52-41fa-a2b3-44abea13b633 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:55.276244 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e1e54399-4c52-41fa-a2b3-44abea13b633 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:55.276967 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e1e54399-4c52-41fa-a2b3-44abea13b633 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:55.277423 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e1e54399-4c52-41fa-a2b3-44abea13b633 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:55.277885 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e1e54399-4c52-41fa-a2b3-44abea13b633 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:55.277984 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eb2bd85a-8bee-4b7a-b197-5998a6365d4a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:55.278376 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eb2bd85a-8bee-4b7a-b197-5998a6365d4a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:55.282740 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eb2bd85a-8bee-4b7a-b197-5998a6365d4a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:55.282740 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eb2bd85a-8bee-4b7a-b197-5998a6365d4a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:55.282740 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eb2bd85a-8bee-4b7a-b197-5998a6365d4a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:55.282740 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eb2bd85a-8bee-4b7a-b197-5998a6365d4a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:55.471502 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e1e54399-4c52-41fa-a2b3-44abea13b633 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:55.475804 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eb2bd85a-8bee-4b7a-b197-5998a6365d4a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:55.479436 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e1e54399-4c52-41fa-a2b3-44abea13b633 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.214916 Aug 24 16:48:55.482123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 68/134] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:55 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:55.483786 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-eb2bd85a-8bee-4b7a-b197-5998a6365d4a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.216610 Aug 24 16:48:55.484345 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 67/135] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:55 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:56.231599 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2d90af90-15dd-4610-a4a6-387ec5970fd0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:56.232201 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2d90af90-15dd-4610-a4a6-387ec5970fd0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:56.238153 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2d90af90-15dd-4610-a4a6-387ec5970fd0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:56.238647 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2d90af90-15dd-4610-a4a6-387ec5970fd0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:56.239062 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2d90af90-15dd-4610-a4a6-387ec5970fd0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:56.239267 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-256aac16-0cae-4af8-8a67-a539e9297992 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:56.239742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2d90af90-15dd-4610-a4a6-387ec5970fd0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:56.239879 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-256aac16-0cae-4af8-8a67-a539e9297992 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:56.240266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2d90af90-15dd-4610-a4a6-387ec5970fd0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:56.240636 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2d90af90-15dd-4610-a4a6-387ec5970fd0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:56.241971 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=99 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:56.256514 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-256aac16-0cae-4af8-8a67-a539e9297992 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:56.257132 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-256aac16-0cae-4af8-8a67-a539e9297992 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:56.258745 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-256aac16-0cae-4af8-8a67-a539e9297992 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:56.259647 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-256aac16-0cae-4af8-8a67-a539e9297992 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:56.260108 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-256aac16-0cae-4af8-8a67-a539e9297992 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:56.260636 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-256aac16-0cae-4af8-8a67-a539e9297992 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:56.452019 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2d90af90-15dd-4610-a4a6-387ec5970fd0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:56.462633 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2d90af90-15dd-4610-a4a6-387ec5970fd0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.235425 Aug 24 16:48:56.470717 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 69/136] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:56 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:56.500874 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d4f8fe38-8e60-42a6-bc1e-803d1490b05d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:56.501692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d4f8fe38-8e60-42a6-bc1e-803d1490b05d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:56.504872 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-256aac16-0cae-4af8-8a67-a539e9297992 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:56.507695 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d4f8fe38-8e60-42a6-bc1e-803d1490b05d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:56.508173 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d4f8fe38-8e60-42a6-bc1e-803d1490b05d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:56.508664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d4f8fe38-8e60-42a6-bc1e-803d1490b05d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:56.509351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d4f8fe38-8e60-42a6-bc1e-803d1490b05d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:56.509797 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d4f8fe38-8e60-42a6-bc1e-803d1490b05d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:56.510227 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d4f8fe38-8e60-42a6-bc1e-803d1490b05d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:56.513459 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-256aac16-0cae-4af8-8a67-a539e9297992 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:56.519008 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-256aac16-0cae-4af8-8a67-a539e9297992 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:56.519008 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-256aac16-0cae-4af8-8a67-a539e9297992 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.280882 Aug 24 16:48:56.519008 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 68/137] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:56 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:56.521405 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e5e7edba-9847-44b2-866d-770e3db8a64a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:56.522011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e5e7edba-9847-44b2-866d-770e3db8a64a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:56.527845 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5e7edba-9847-44b2-866d-770e3db8a64a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:56.528563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5e7edba-9847-44b2-866d-770e3db8a64a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:56.529175 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5e7edba-9847-44b2-866d-770e3db8a64a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:56.530080 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5e7edba-9847-44b2-866d-770e3db8a64a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:56.530685 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5e7edba-9847-44b2-866d-770e3db8a64a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:56.531300 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5e7edba-9847-44b2-866d-770e3db8a64a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:56.711237 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d4f8fe38-8e60-42a6-bc1e-803d1490b05d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:56.716488 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e5e7edba-9847-44b2-866d-770e3db8a64a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:56.720427 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d4f8fe38-8e60-42a6-bc1e-803d1490b05d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.223551 Aug 24 16:48:56.725456 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e5e7edba-9847-44b2-866d-770e3db8a64a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.207756 Aug 24 16:48:56.726236 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 69/138] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:56 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:56.732775 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 70/139] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:56 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:57.483379 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-af4d17fc-6f2a-4f86-a929-933f7a86ff56 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:57.483929 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-af4d17fc-6f2a-4f86-a929-933f7a86ff56 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:57.490007 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af4d17fc-6f2a-4f86-a929-933f7a86ff56 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:57.490514 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af4d17fc-6f2a-4f86-a929-933f7a86ff56 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:57.491001 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af4d17fc-6f2a-4f86-a929-933f7a86ff56 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:57.491747 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af4d17fc-6f2a-4f86-a929-933f7a86ff56 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:57.492252 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af4d17fc-6f2a-4f86-a929-933f7a86ff56 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:57.492729 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af4d17fc-6f2a-4f86-a929-933f7a86ff56 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:57.539333 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-dcde4042-d37b-4e39-9826-63ce029b1bd7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:57.539948 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-dcde4042-d37b-4e39-9826-63ce029b1bd7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:57.545834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dcde4042-d37b-4e39-9826-63ce029b1bd7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:57.546315 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dcde4042-d37b-4e39-9826-63ce029b1bd7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:57.546741 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dcde4042-d37b-4e39-9826-63ce029b1bd7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:57.547423 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dcde4042-d37b-4e39-9826-63ce029b1bd7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:57.547872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dcde4042-d37b-4e39-9826-63ce029b1bd7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:57.548288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dcde4042-d37b-4e39-9826-63ce029b1bd7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:57.687672 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-af4d17fc-6f2a-4f86-a929-933f7a86ff56 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:57.696279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-af4d17fc-6f2a-4f86-a929-933f7a86ff56 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.216980 Aug 24 16:48:57.708601 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 70/140] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:57 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:57.714318 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-dcde4042-d37b-4e39-9826-63ce029b1bd7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:57.723312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-dcde4042-d37b-4e39-9826-63ce029b1bd7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:57.724856 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-dcde4042-d37b-4e39-9826-63ce029b1bd7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:57.725987 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-dcde4042-d37b-4e39-9826-63ce029b1bd7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.190686 Aug 24 16:48:57.726543 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 71/141] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:57 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:48:57.744061 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-69c4d484-712c-41f4-9da8-456851df798a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:57.745213 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-69c4d484-712c-41f4-9da8-456851df798a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:57.746404 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-08cdda0b-80ff-41b0-be4d-9c810693043a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:57.747015 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-08cdda0b-80ff-41b0-be4d-9c810693043a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:57.752930 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08cdda0b-80ff-41b0-be4d-9c810693043a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:57.753089 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69c4d484-712c-41f4-9da8-456851df798a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:57.753418 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08cdda0b-80ff-41b0-be4d-9c810693043a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:57.753534 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69c4d484-712c-41f4-9da8-456851df798a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:57.753856 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08cdda0b-80ff-41b0-be4d-9c810693043a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:57.753957 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69c4d484-712c-41f4-9da8-456851df798a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:57.754551 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08cdda0b-80ff-41b0-be4d-9c810693043a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:57.754650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69c4d484-712c-41f4-9da8-456851df798a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:57.755005 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08cdda0b-80ff-41b0-be4d-9c810693043a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:57.755188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69c4d484-712c-41f4-9da8-456851df798a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:57.755421 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08cdda0b-80ff-41b0-be4d-9c810693043a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:57.755555 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69c4d484-712c-41f4-9da8-456851df798a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:57.961048 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-69c4d484-712c-41f4-9da8-456851df798a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:57.964305 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-08cdda0b-80ff-41b0-be4d-9c810693043a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:57.975450 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-08cdda0b-80ff-41b0-be4d-9c810693043a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.233562 Aug 24 16:48:57.976125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-69c4d484-712c-41f4-9da8-456851df798a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.236928 Aug 24 16:48:57.976495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 72/142] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:57 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:57.981597 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 71/143] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:57 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:58.720369 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-bdc1ef98-c0ee-4f59-8e2f-80c33c840748 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:58.721555 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-bdc1ef98-c0ee-4f59-8e2f-80c33c840748 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:58.731583 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bdc1ef98-c0ee-4f59-8e2f-80c33c840748 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:58.732090 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bdc1ef98-c0ee-4f59-8e2f-80c33c840748 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:58.734295 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bdc1ef98-c0ee-4f59-8e2f-80c33c840748 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:58.735042 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bdc1ef98-c0ee-4f59-8e2f-80c33c840748 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:58.735508 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bdc1ef98-c0ee-4f59-8e2f-80c33c840748 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:58.738345 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bdc1ef98-c0ee-4f59-8e2f-80c33c840748 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:58.755599 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8a64ab90-7957-4ccb-99e1-7bd7c5321c3a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:58.756918 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8a64ab90-7957-4ccb-99e1-7bd7c5321c3a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:58.763623 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a64ab90-7957-4ccb-99e1-7bd7c5321c3a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:58.764108 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a64ab90-7957-4ccb-99e1-7bd7c5321c3a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:58.764571 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a64ab90-7957-4ccb-99e1-7bd7c5321c3a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:58.765271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a64ab90-7957-4ccb-99e1-7bd7c5321c3a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:58.765722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a64ab90-7957-4ccb-99e1-7bd7c5321c3a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:58.766138 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a64ab90-7957-4ccb-99e1-7bd7c5321c3a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:58.978230 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-bdc1ef98-c0ee-4f59-8e2f-80c33c840748 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:58.998698 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8a64ab90-7957-4ccb-99e1-7bd7c5321c3a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:58.998834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-bdc1ef98-c0ee-4f59-8e2f-80c33c840748 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.273782 Aug 24 16:48:58.998834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 73/144] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:58 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:48:58.998834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ffbd10b9-00b8-4d08-be15-59d977a2b1a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:58.998834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ffbd10b9-00b8-4d08-be15-59d977a2b1a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:59.005283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ffbd10b9-00b8-4d08-be15-59d977a2b1a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:59.005797 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ffbd10b9-00b8-4d08-be15-59d977a2b1a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:59.006230 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ffbd10b9-00b8-4d08-be15-59d977a2b1a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:59.006935 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ffbd10b9-00b8-4d08-be15-59d977a2b1a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:59.007397 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ffbd10b9-00b8-4d08-be15-59d977a2b1a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:59.007803 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ffbd10b9-00b8-4d08-be15-59d977a2b1a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:59.016633 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8a64ab90-7957-4ccb-99e1-7bd7c5321c3a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:59.018746 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8a64ab90-7957-4ccb-99e1-7bd7c5321c3a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:59.020743 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8a64ab90-7957-4ccb-99e1-7bd7c5321c3a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.268711 Aug 24 16:48:59.033334 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 72/145] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:48:58 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:48:59.043142 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8038a19a-ab45-48c1-bc07-9e5c714cd0de tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:59.043935 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8038a19a-ab45-48c1-bc07-9e5c714cd0de tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:59.050656 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8038a19a-ab45-48c1-bc07-9e5c714cd0de tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:59.051293 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8038a19a-ab45-48c1-bc07-9e5c714cd0de tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:59.051863 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8038a19a-ab45-48c1-bc07-9e5c714cd0de tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:59.052806 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8038a19a-ab45-48c1-bc07-9e5c714cd0de tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:59.053409 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8038a19a-ab45-48c1-bc07-9e5c714cd0de tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:59.053968 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8038a19a-ab45-48c1-bc07-9e5c714cd0de tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:59.234626 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ffbd10b9-00b8-4d08-be15-59d977a2b1a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:59.256793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ffbd10b9-00b8-4d08-be15-59d977a2b1a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.263798 Aug 24 16:48:59.257415 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 74/146] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:58 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:59.265174 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8038a19a-ab45-48c1-bc07-9e5c714cd0de tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:59.275268 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8038a19a-ab45-48c1-bc07-9e5c714cd0de tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.239216 Aug 24 16:48:59.275268 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 73/147] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:59 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:00.015064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f55ef4a4-f0c8-4272-96fa-daa273ee3efe tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:00.015877 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f55ef4a4-f0c8-4272-96fa-daa273ee3efe tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:00.024226 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f55ef4a4-f0c8-4272-96fa-daa273ee3efe tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:00.028651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f55ef4a4-f0c8-4272-96fa-daa273ee3efe tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:00.028651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f55ef4a4-f0c8-4272-96fa-daa273ee3efe tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:00.028651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f55ef4a4-f0c8-4272-96fa-daa273ee3efe tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:00.028651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f55ef4a4-f0c8-4272-96fa-daa273ee3efe tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:00.031050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f55ef4a4-f0c8-4272-96fa-daa273ee3efe tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:00.049075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-548dbdb1-8e73-4d50-8c5b-b7094b338e22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:00.049695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-548dbdb1-8e73-4d50-8c5b-b7094b338e22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:00.055940 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-548dbdb1-8e73-4d50-8c5b-b7094b338e22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:00.056723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-548dbdb1-8e73-4d50-8c5b-b7094b338e22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:00.058165 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-548dbdb1-8e73-4d50-8c5b-b7094b338e22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:00.059136 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-548dbdb1-8e73-4d50-8c5b-b7094b338e22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:00.059922 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-548dbdb1-8e73-4d50-8c5b-b7094b338e22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:00.060572 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-548dbdb1-8e73-4d50-8c5b-b7094b338e22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:00.328902 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f55ef4a4-f0c8-4272-96fa-daa273ee3efe tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:00.330775 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-548dbdb1-8e73-4d50-8c5b-b7094b338e22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:00.362482 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f55ef4a4-f0c8-4272-96fa-daa273ee3efe tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.338463 Aug 24 16:49:00.363178 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 75/148] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:00 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:00.375797 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-85cb912e-bc81-4e9a-94b7-7ea3781c28a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:00.381235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-85cb912e-bc81-4e9a-94b7-7ea3781c28a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:00.385152 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-548dbdb1-8e73-4d50-8c5b-b7094b338e22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:00.391190 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-548dbdb1-8e73-4d50-8c5b-b7094b338e22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:00.395025 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-548dbdb1-8e73-4d50-8c5b-b7094b338e22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.349715 Aug 24 16:49:00.398517 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 74/149] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:00 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:00.405896 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85cb912e-bc81-4e9a-94b7-7ea3781c28a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:00.407700 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85cb912e-bc81-4e9a-94b7-7ea3781c28a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:00.408311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85cb912e-bc81-4e9a-94b7-7ea3781c28a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:00.408902 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fb070e6d-4de6-4c59-b810-e01f28c412fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:00.409787 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85cb912e-bc81-4e9a-94b7-7ea3781c28a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:00.412533 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fb070e6d-4de6-4c59-b810-e01f28c412fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:00.412675 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85cb912e-bc81-4e9a-94b7-7ea3781c28a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:00.413109 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85cb912e-bc81-4e9a-94b7-7ea3781c28a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:00.427824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb070e6d-4de6-4c59-b810-e01f28c412fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:00.428726 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb070e6d-4de6-4c59-b810-e01f28c412fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:00.429385 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb070e6d-4de6-4c59-b810-e01f28c412fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:00.430484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb070e6d-4de6-4c59-b810-e01f28c412fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:00.431549 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb070e6d-4de6-4c59-b810-e01f28c412fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:00.432279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb070e6d-4de6-4c59-b810-e01f28c412fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:00.640492 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-85cb912e-bc81-4e9a-94b7-7ea3781c28a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:00.653284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fb070e6d-4de6-4c59-b810-e01f28c412fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:00.653462 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-85cb912e-bc81-4e9a-94b7-7ea3781c28a5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.288775 Aug 24 16:49:00.653932 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 76/150] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:00 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:00.673129 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fb070e6d-4de6-4c59-b810-e01f28c412fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.270897 Aug 24 16:49:00.674026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 75/151] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:00 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:00.823657 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-41b89e89-bfa0-4fe3-97a7-73edb49467fd req-134a8b6f-1998-425e-9152-dc26d16c3804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568dd29c-4de9-49b4-84f1-44183e65c82d", "name": "network-vif-plugged", "status": "completed", "tag": "5cff7808-c87f-4402-a7eb-99555211c7b8"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:00.834246 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-41b89e89-bfa0-4fe3-97a7-73edb49467fd req-134a8b6f-1998-425e-9152-dc26d16c3804 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:00.838945 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-41b89e89-bfa0-4fe3-97a7-73edb49467fd req-134a8b6f-1998-425e-9152-dc26d16c3804 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:00.838945 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-41b89e89-bfa0-4fe3-97a7-73edb49467fd req-134a8b6f-1998-425e-9152-dc26d16c3804 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:00.864024 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-41b89e89-bfa0-4fe3-97a7-73edb49467fd req-134a8b6f-1998-425e-9152-dc26d16c3804 service nova] Creating event network-vif-plugged:5cff7808-c87f-4402-a7eb-99555211c7b8 for instance 568dd29c-4de9-49b4-84f1-44183e65c82d on hv-cinder-85220 Aug 24 16:49:00.871785 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-41b89e89-bfa0-4fe3-97a7-73edb49467fd req-134a8b6f-1998-425e-9152-dc26d16c3804 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215862 Aug 24 16:49:00.872531 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 77/152] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:01.393640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e8640dbb-8413-4d2f-abae-7b24331b4646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:01.393640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e8640dbb-8413-4d2f-abae-7b24331b4646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:01.393640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8640dbb-8413-4d2f-abae-7b24331b4646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:01.393640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8640dbb-8413-4d2f-abae-7b24331b4646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:01.394713 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8640dbb-8413-4d2f-abae-7b24331b4646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:01.394713 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8640dbb-8413-4d2f-abae-7b24331b4646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:01.394713 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8640dbb-8413-4d2f-abae-7b24331b4646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:01.394713 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8640dbb-8413-4d2f-abae-7b24331b4646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:01.396545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=100 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:01.421863 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-31fc52d6-62fd-47d6-85b2-3cf9c4cf4670 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:01.427938 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-31fc52d6-62fd-47d6-85b2-3cf9c4cf4670 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:01.429977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-31fc52d6-62fd-47d6-85b2-3cf9c4cf4670 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:01.430459 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-31fc52d6-62fd-47d6-85b2-3cf9c4cf4670 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:01.430889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-31fc52d6-62fd-47d6-85b2-3cf9c4cf4670 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:01.431578 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-31fc52d6-62fd-47d6-85b2-3cf9c4cf4670 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:01.432025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-31fc52d6-62fd-47d6-85b2-3cf9c4cf4670 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:01.432463 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-31fc52d6-62fd-47d6-85b2-3cf9c4cf4670 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:01.598776 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e8640dbb-8413-4d2f-abae-7b24331b4646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:01.610786 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e8640dbb-8413-4d2f-abae-7b24331b4646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.231018 Aug 24 16:49:01.611181 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 76/153] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:01 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:01.645442 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-31fc52d6-62fd-47d6-85b2-3cf9c4cf4670 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:01.656632 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-31fc52d6-62fd-47d6-85b2-3cf9c4cf4670 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:01.663390 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-31fc52d6-62fd-47d6-85b2-3cf9c4cf4670 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:01.665676 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-31fc52d6-62fd-47d6-85b2-3cf9c4cf4670 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.248838 Aug 24 16:49:01.677368 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-20151e83-5513-4421-a380-e2443347a95d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:01.678115 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-20151e83-5513-4421-a380-e2443347a95d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:01.678558 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 78/154] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:01 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:01.702707 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5dba1d17-2e64-4e9c-9450-cb995163ae87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:01.703332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5dba1d17-2e64-4e9c-9450-cb995163ae87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:01.704935 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20151e83-5513-4421-a380-e2443347a95d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:01.708425 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20151e83-5513-4421-a380-e2443347a95d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:01.709205 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20151e83-5513-4421-a380-e2443347a95d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:01.710073 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20151e83-5513-4421-a380-e2443347a95d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:01.711745 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20151e83-5513-4421-a380-e2443347a95d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:01.712975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20151e83-5513-4421-a380-e2443347a95d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:01.713669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5dba1d17-2e64-4e9c-9450-cb995163ae87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:01.714172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5dba1d17-2e64-4e9c-9450-cb995163ae87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:01.715165 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5dba1d17-2e64-4e9c-9450-cb995163ae87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:01.721366 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5dba1d17-2e64-4e9c-9450-cb995163ae87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:01.725148 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5dba1d17-2e64-4e9c-9450-cb995163ae87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:01.725789 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5dba1d17-2e64-4e9c-9450-cb995163ae87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:01.970226 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-5dba1d17-2e64-4e9c-9450-cb995163ae87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:01.971651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-20151e83-5513-4421-a380-e2443347a95d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:01.980649 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-20151e83-5513-4421-a380-e2443347a95d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.309361 Aug 24 16:49:01.994846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 77/155] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:01 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:02.006451 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5dba1d17-2e64-4e9c-9450-cb995163ae87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.309462 Aug 24 16:49:02.006451 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 79/156] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:01 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:02.634849 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4f4bae88-6e2f-4807-a85d-0a99e140d5be tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:02.636148 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4f4bae88-6e2f-4807-a85d-0a99e140d5be tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:02.642675 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f4bae88-6e2f-4807-a85d-0a99e140d5be tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:02.643420 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f4bae88-6e2f-4807-a85d-0a99e140d5be tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:02.643932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f4bae88-6e2f-4807-a85d-0a99e140d5be tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:02.644722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f4bae88-6e2f-4807-a85d-0a99e140d5be tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:02.645235 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f4bae88-6e2f-4807-a85d-0a99e140d5be tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:02.645768 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f4bae88-6e2f-4807-a85d-0a99e140d5be tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:02.691006 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-91301e10-fd9e-4deb-bae8-8864ac598c75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:02.692134 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-91301e10-fd9e-4deb-bae8-8864ac598c75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:02.705332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-91301e10-fd9e-4deb-bae8-8864ac598c75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:02.705798 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-91301e10-fd9e-4deb-bae8-8864ac598c75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:02.706408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-91301e10-fd9e-4deb-bae8-8864ac598c75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:02.707278 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-91301e10-fd9e-4deb-bae8-8864ac598c75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:02.708040 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-91301e10-fd9e-4deb-bae8-8864ac598c75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:02.708644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-91301e10-fd9e-4deb-bae8-8864ac598c75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:02.844084 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4f4bae88-6e2f-4807-a85d-0a99e140d5be tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:02.852081 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4f4bae88-6e2f-4807-a85d-0a99e140d5be tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.221224 Aug 24 16:49:02.852899 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 78/157] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:02 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:02.877766 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-91301e10-fd9e-4deb-bae8-8864ac598c75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:02.886506 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-91301e10-fd9e-4deb-bae8-8864ac598c75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:02.888225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-91301e10-fd9e-4deb-bae8-8864ac598c75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:02.889510 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-91301e10-fd9e-4deb-bae8-8864ac598c75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.202332 Aug 24 16:49:02.890160 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 80/158] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:02 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:03.001439 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-568ce59f-ed8a-4551-97c4-689a09904166 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:03.002058 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-568ce59f-ed8a-4551-97c4-689a09904166 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:03.008147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-568ce59f-ed8a-4551-97c4-689a09904166 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:03.008669 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-568ce59f-ed8a-4551-97c4-689a09904166 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:03.009178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-568ce59f-ed8a-4551-97c4-689a09904166 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:03.009883 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-568ce59f-ed8a-4551-97c4-689a09904166 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:03.010338 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-568ce59f-ed8a-4551-97c4-689a09904166 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:03.010765 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-568ce59f-ed8a-4551-97c4-689a09904166 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:03.025952 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2df24889-4c20-4505-9bdc-45bdf7165b4f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:03.026555 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2df24889-4c20-4505-9bdc-45bdf7165b4f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:03.033462 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2df24889-4c20-4505-9bdc-45bdf7165b4f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:03.033960 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2df24889-4c20-4505-9bdc-45bdf7165b4f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:03.034370 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2df24889-4c20-4505-9bdc-45bdf7165b4f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:03.035233 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2df24889-4c20-4505-9bdc-45bdf7165b4f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:03.035688 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2df24889-4c20-4505-9bdc-45bdf7165b4f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:03.036099 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2df24889-4c20-4505-9bdc-45bdf7165b4f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:03.203256 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-568ce59f-ed8a-4551-97c4-689a09904166 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:03.210904 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-568ce59f-ed8a-4551-97c4-689a09904166 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.213415 Aug 24 16:49:03.211480 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 79/159] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:02 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:03.219516 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2df24889-4c20-4505-9bdc-45bdf7165b4f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:03.223280 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:03.228008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2df24889-4c20-4505-9bdc-45bdf7165b4f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.206050 Aug 24 16:49:03.228612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 81/160] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:03 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:03.874132 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fcfc4723-7633-4ba3-918c-6777debbe833 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:03.874743 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fcfc4723-7633-4ba3-918c-6777debbe833 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:03.880666 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fcfc4723-7633-4ba3-918c-6777debbe833 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:03.881349 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fcfc4723-7633-4ba3-918c-6777debbe833 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:03.881724 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fcfc4723-7633-4ba3-918c-6777debbe833 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:03.882424 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fcfc4723-7633-4ba3-918c-6777debbe833 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:03.882878 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fcfc4723-7633-4ba3-918c-6777debbe833 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:03.883304 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fcfc4723-7633-4ba3-918c-6777debbe833 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:03.912189 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e382210f-5808-4f4d-8892-834df1a8a287 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:03.913526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e382210f-5808-4f4d-8892-834df1a8a287 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:03.922490 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e382210f-5808-4f4d-8892-834df1a8a287 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:03.922995 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e382210f-5808-4f4d-8892-834df1a8a287 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:03.923424 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e382210f-5808-4f4d-8892-834df1a8a287 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:03.925848 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e382210f-5808-4f4d-8892-834df1a8a287 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:03.925848 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e382210f-5808-4f4d-8892-834df1a8a287 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:03.925848 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e382210f-5808-4f4d-8892-834df1a8a287 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:04.251714 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fcfc4723-7633-4ba3-918c-6777debbe833 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:04.260752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fcfc4723-7633-4ba3-918c-6777debbe833 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.390911 Aug 24 16:49:04.262136 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 80/161] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:03 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:04.267072 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-425ac862-7667-4ec8-9a6b-95c61f7411a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:04.267869 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-425ac862-7667-4ec8-9a6b-95c61f7411a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:04.275140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-425ac862-7667-4ec8-9a6b-95c61f7411a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:04.277007 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-425ac862-7667-4ec8-9a6b-95c61f7411a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:04.277007 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-425ac862-7667-4ec8-9a6b-95c61f7411a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:04.277007 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-425ac862-7667-4ec8-9a6b-95c61f7411a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:04.277289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-425ac862-7667-4ec8-9a6b-95c61f7411a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:04.277945 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-425ac862-7667-4ec8-9a6b-95c61f7411a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:04.293643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e382210f-5808-4f4d-8892-834df1a8a287 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:04.302144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e382210f-5808-4f4d-8892-834df1a8a287 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:04.303912 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e382210f-5808-4f4d-8892-834df1a8a287 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:04.305069 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e382210f-5808-4f4d-8892-834df1a8a287 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.397053 Aug 24 16:49:04.305671 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 82/162] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:03 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:04.321798 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1e8f35b9-c774-4c20-ac72-2f3dccc553eb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:04.323019 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1e8f35b9-c774-4c20-ac72-2f3dccc553eb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:04.327536 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:04.331147 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1e8f35b9-c774-4c20-ac72-2f3dccc553eb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:04.331805 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1e8f35b9-c774-4c20-ac72-2f3dccc553eb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:04.332245 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1e8f35b9-c774-4c20-ac72-2f3dccc553eb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:04.332994 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1e8f35b9-c774-4c20-ac72-2f3dccc553eb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:04.333447 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1e8f35b9-c774-4c20-ac72-2f3dccc553eb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:04.333873 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1e8f35b9-c774-4c20-ac72-2f3dccc553eb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:04.459522 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-425ac862-7667-4ec8-9a6b-95c61f7411a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:04.467427 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-425ac862-7667-4ec8-9a6b-95c61f7411a7 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.204003 Aug 24 16:49:04.468216 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 81/163] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:04 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:04.494946 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1e8f35b9-c774-4c20-ac72-2f3dccc553eb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:04.503009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1e8f35b9-c774-4c20-ac72-2f3dccc553eb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.196211 Aug 24 16:49:04.503576 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 83/164] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:04 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:05.285186 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3abab6fe-8eb6-4bad-a0f0-35a7ac9d8187 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:05.285906 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3abab6fe-8eb6-4bad-a0f0-35a7ac9d8187 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:05.292139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3abab6fe-8eb6-4bad-a0f0-35a7ac9d8187 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:05.293217 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3abab6fe-8eb6-4bad-a0f0-35a7ac9d8187 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:05.293649 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3abab6fe-8eb6-4bad-a0f0-35a7ac9d8187 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:05.294331 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3abab6fe-8eb6-4bad-a0f0-35a7ac9d8187 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:05.294781 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3abab6fe-8eb6-4bad-a0f0-35a7ac9d8187 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:05.295196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3abab6fe-8eb6-4bad-a0f0-35a7ac9d8187 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:05.327979 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-29241b8d-b276-4699-bf48-552a2e114584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:05.328877 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-29241b8d-b276-4699-bf48-552a2e114584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:05.335344 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-29241b8d-b276-4699-bf48-552a2e114584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:05.336102 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-29241b8d-b276-4699-bf48-552a2e114584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:05.336591 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-29241b8d-b276-4699-bf48-552a2e114584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:05.337289 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-29241b8d-b276-4699-bf48-552a2e114584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:05.337743 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-29241b8d-b276-4699-bf48-552a2e114584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:05.338170 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-29241b8d-b276-4699-bf48-552a2e114584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:05.466218 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3abab6fe-8eb6-4bad-a0f0-35a7ac9d8187 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:05.473894 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3abab6fe-8eb6-4bad-a0f0-35a7ac9d8187 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.192971 Aug 24 16:49:05.474501 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 82/165] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:05 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:05.494030 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cffc835c-4584-4871-b1f9-7804cf37ce8c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:05.494645 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cffc835c-4584-4871-b1f9-7804cf37ce8c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:05.500729 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cffc835c-4584-4871-b1f9-7804cf37ce8c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:05.501210 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cffc835c-4584-4871-b1f9-7804cf37ce8c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:05.501642 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cffc835c-4584-4871-b1f9-7804cf37ce8c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:05.502394 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cffc835c-4584-4871-b1f9-7804cf37ce8c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:05.502776 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cffc835c-4584-4871-b1f9-7804cf37ce8c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:05.503193 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cffc835c-4584-4871-b1f9-7804cf37ce8c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:05.504342 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-29241b8d-b276-4699-bf48-552a2e114584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:05.513337 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-29241b8d-b276-4699-bf48-552a2e114584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:05.514837 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-29241b8d-b276-4699-bf48-552a2e114584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:05.515961 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-29241b8d-b276-4699-bf48-552a2e114584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.192013 Aug 24 16:49:05.517968 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 84/166] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:05 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:05.522799 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-529d3bb0-8bd1-4c9d-bcba-8c2b754e9831 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:05.523441 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-529d3bb0-8bd1-4c9d-bcba-8c2b754e9831 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:05.529983 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-529d3bb0-8bd1-4c9d-bcba-8c2b754e9831 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:05.530467 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-529d3bb0-8bd1-4c9d-bcba-8c2b754e9831 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:05.534185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-529d3bb0-8bd1-4c9d-bcba-8c2b754e9831 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:05.534185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-529d3bb0-8bd1-4c9d-bcba-8c2b754e9831 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:05.534185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-529d3bb0-8bd1-4c9d-bcba-8c2b754e9831 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:05.534185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-529d3bb0-8bd1-4c9d-bcba-8c2b754e9831 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:05.701808 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cffc835c-4584-4871-b1f9-7804cf37ce8c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:05.711434 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cffc835c-4584-4871-b1f9-7804cf37ce8c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.220882 Aug 24 16:49:05.711434 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 83/167] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:05 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:05.712626 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-529d3bb0-8bd1-4c9d-bcba-8c2b754e9831 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:05.723154 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-529d3bb0-8bd1-4c9d-bcba-8c2b754e9831 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.203979 Aug 24 16:49:05.734949 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 85/168] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:05 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:06.094702 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-1ebfe760-0a29-43ae-9bb8-6f968b9cf1b7 req-4af26807-129a-4728-80de-84cbe4bb1f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b", "name": "network-vif-plugged", "status": "completed", "tag": "eebf25cb-9859-40a8-8cd8-a778ec3005bd"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:06.108269 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-1ebfe760-0a29-43ae-9bb8-6f968b9cf1b7 req-4af26807-129a-4728-80de-84cbe4bb1f0a service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:06.108774 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-1ebfe760-0a29-43ae-9bb8-6f968b9cf1b7 req-4af26807-129a-4728-80de-84cbe4bb1f0a service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:06.109251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-1ebfe760-0a29-43ae-9bb8-6f968b9cf1b7 req-4af26807-129a-4728-80de-84cbe4bb1f0a service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:06.137045 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-1ebfe760-0a29-43ae-9bb8-6f968b9cf1b7 req-4af26807-129a-4728-80de-84cbe4bb1f0a service nova] Creating event network-vif-plugged:eebf25cb-9859-40a8-8cd8-a778ec3005bd for instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b on hv-cinder-85220 Aug 24 16:49:06.146974 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-1ebfe760-0a29-43ae-9bb8-6f968b9cf1b7 req-4af26807-129a-4728-80de-84cbe4bb1f0a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055781 Aug 24 16:49:06.147895 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 84/169] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:06.494978 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f41a30c7-ee91-4495-acff-74117ba84646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:06.496006 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f41a30c7-ee91-4495-acff-74117ba84646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:06.504046 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f41a30c7-ee91-4495-acff-74117ba84646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:06.506438 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f41a30c7-ee91-4495-acff-74117ba84646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:06.506438 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f41a30c7-ee91-4495-acff-74117ba84646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:06.506438 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f41a30c7-ee91-4495-acff-74117ba84646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:06.506438 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f41a30c7-ee91-4495-acff-74117ba84646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:06.506725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f41a30c7-ee91-4495-acff-74117ba84646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:06.541420 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-687c3d82-0132-47d5-b988-9f3061f82a24 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:06.542136 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-687c3d82-0132-47d5-b988-9f3061f82a24 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:06.568277 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-687c3d82-0132-47d5-b988-9f3061f82a24 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:06.568864 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-687c3d82-0132-47d5-b988-9f3061f82a24 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:06.569295 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-687c3d82-0132-47d5-b988-9f3061f82a24 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:06.581428 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-687c3d82-0132-47d5-b988-9f3061f82a24 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:06.582154 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-687c3d82-0132-47d5-b988-9f3061f82a24 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:06.582790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-687c3d82-0132-47d5-b988-9f3061f82a24 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:06.889003 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f41a30c7-ee91-4495-acff-74117ba84646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:06.914437 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f41a30c7-ee91-4495-acff-74117ba84646 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.421526 Aug 24 16:49:06.916308 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 86/170] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:06 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:06.922405 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c6803661-a526-4436-9bd0-3e790f3903f2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:06.923229 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c6803661-a526-4436-9bd0-3e790f3903f2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:06.939866 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-687c3d82-0132-47d5-b988-9f3061f82a24 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:06.948029 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-687c3d82-0132-47d5-b988-9f3061f82a24 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:06.951009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6803661-a526-4436-9bd0-3e790f3903f2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:06.951540 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6803661-a526-4436-9bd0-3e790f3903f2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:06.953782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-687c3d82-0132-47d5-b988-9f3061f82a24 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:06.955096 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6803661-a526-4436-9bd0-3e790f3903f2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:06.955909 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6803661-a526-4436-9bd0-3e790f3903f2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:06.956385 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6803661-a526-4436-9bd0-3e790f3903f2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:06.957061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6803661-a526-4436-9bd0-3e790f3903f2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:06.957605 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-687c3d82-0132-47d5-b988-9f3061f82a24 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.421409 Aug 24 16:49:06.976596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 85/171] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:06 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:06.981356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b7f31b4e-a470-48f4-8005-07089728cf5a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:06.981976 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b7f31b4e-a470-48f4-8005-07089728cf5a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:06.997426 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7f31b4e-a470-48f4-8005-07089728cf5a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:06.999871 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7f31b4e-a470-48f4-8005-07089728cf5a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:06.999871 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7f31b4e-a470-48f4-8005-07089728cf5a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:07.005785 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7f31b4e-a470-48f4-8005-07089728cf5a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:07.005785 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7f31b4e-a470-48f4-8005-07089728cf5a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:07.006626 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7f31b4e-a470-48f4-8005-07089728cf5a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:07.319429 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c6803661-a526-4436-9bd0-3e790f3903f2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:07.319429 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c6803661-a526-4436-9bd0-3e790f3903f2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.398355 Aug 24 16:49:07.319429 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 87/172] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:06 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:07.332643 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b7f31b4e-a470-48f4-8005-07089728cf5a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:07.341446 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b7f31b4e-a470-48f4-8005-07089728cf5a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.363822 Aug 24 16:49:07.342106 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 86/173] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:06 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:07.941496 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-826fd07e-9bdb-4f08-8253-48d766b9eac4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:07.942098 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-826fd07e-9bdb-4f08-8253-48d766b9eac4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:07.947888 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-826fd07e-9bdb-4f08-8253-48d766b9eac4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:07.948393 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-826fd07e-9bdb-4f08-8253-48d766b9eac4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:07.948892 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-826fd07e-9bdb-4f08-8253-48d766b9eac4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:07.950006 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-826fd07e-9bdb-4f08-8253-48d766b9eac4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:07.950663 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-826fd07e-9bdb-4f08-8253-48d766b9eac4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:07.951086 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-826fd07e-9bdb-4f08-8253-48d766b9eac4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:07.984526 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2deb44b8-768b-4012-a05e-0ebdc3df9336 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:07.984997 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2deb44b8-768b-4012-a05e-0ebdc3df9336 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:07.993169 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2deb44b8-768b-4012-a05e-0ebdc3df9336 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:07.996864 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2deb44b8-768b-4012-a05e-0ebdc3df9336 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:07.996864 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2deb44b8-768b-4012-a05e-0ebdc3df9336 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:07.996864 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2deb44b8-768b-4012-a05e-0ebdc3df9336 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:07.996864 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2deb44b8-768b-4012-a05e-0ebdc3df9336 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:07.997265 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2deb44b8-768b-4012-a05e-0ebdc3df9336 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:08.144294 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-826fd07e-9bdb-4f08-8253-48d766b9eac4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:08.153192 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-826fd07e-9bdb-4f08-8253-48d766b9eac4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.215456 Aug 24 16:49:08.153764 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 88/174] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:07 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:08.175828 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2deb44b8-768b-4012-a05e-0ebdc3df9336 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:08.185500 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2deb44b8-768b-4012-a05e-0ebdc3df9336 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:08.187156 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2deb44b8-768b-4012-a05e-0ebdc3df9336 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:08.188678 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2deb44b8-768b-4012-a05e-0ebdc3df9336 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.209054 Aug 24 16:49:08.189240 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 87/175] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:07 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:08.205064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-59452ec1-cf7d-43fa-9864-a094bd931179 req-4af5e868-9db9-47c2-8419-782b2cf4610a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5377571a-2ee1-4cb8-b47e-cd4f48808e8b", "name": "network-vif-plugged", "status": "completed", "tag": "5892788f-be73-4ceb-af43-492175260ae5"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:08.214335 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-59452ec1-cf7d-43fa-9864-a094bd931179 req-4af5e868-9db9-47c2-8419-782b2cf4610a service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:08.214810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-59452ec1-cf7d-43fa-9864-a094bd931179 req-4af5e868-9db9-47c2-8419-782b2cf4610a service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:08.215236 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-59452ec1-cf7d-43fa-9864-a094bd931179 req-4af5e868-9db9-47c2-8419-782b2cf4610a service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:08.228007 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-59452ec1-cf7d-43fa-9864-a094bd931179 req-4af5e868-9db9-47c2-8419-782b2cf4610a service nova] Creating event network-vif-plugged:5892788f-be73-4ceb-af43-492175260ae5 for instance 5377571a-2ee1-4cb8-b47e-cd4f48808e8b on hv-cinder-85220 Aug 24 16:49:08.233971 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-59452ec1-cf7d-43fa-9864-a094bd931179 req-4af5e868-9db9-47c2-8419-782b2cf4610a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035904 Aug 24 16:49:08.234538 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 89/176] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:08.340277 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0cc6e042-8189-4bff-a137-55321b02b5a1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:08.340839 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0cc6e042-8189-4bff-a137-55321b02b5a1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:08.346661 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cc6e042-8189-4bff-a137-55321b02b5a1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:08.347135 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cc6e042-8189-4bff-a137-55321b02b5a1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:08.347560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cc6e042-8189-4bff-a137-55321b02b5a1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:08.348235 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cc6e042-8189-4bff-a137-55321b02b5a1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:08.348753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cc6e042-8189-4bff-a137-55321b02b5a1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:08.349172 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cc6e042-8189-4bff-a137-55321b02b5a1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:08.365741 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-118b9349-9f8a-474a-8a29-dbcc9a2e265d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:08.366549 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-118b9349-9f8a-474a-8a29-dbcc9a2e265d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:08.375288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-118b9349-9f8a-474a-8a29-dbcc9a2e265d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:08.375604 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-118b9349-9f8a-474a-8a29-dbcc9a2e265d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:08.376034 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-118b9349-9f8a-474a-8a29-dbcc9a2e265d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:08.376749 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-118b9349-9f8a-474a-8a29-dbcc9a2e265d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:08.377328 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-118b9349-9f8a-474a-8a29-dbcc9a2e265d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:08.377669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-118b9349-9f8a-474a-8a29-dbcc9a2e265d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:08.562642 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0cc6e042-8189-4bff-a137-55321b02b5a1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:08.567636 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-118b9349-9f8a-474a-8a29-dbcc9a2e265d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:08.570573 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0cc6e042-8189-4bff-a137-55321b02b5a1 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.234229 Aug 24 16:49:08.571137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 88/177] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:08 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:08.579872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-118b9349-9f8a-474a-8a29-dbcc9a2e265d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.217337 Aug 24 16:49:08.579872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 90/178] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:08 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:09.174102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e3590bdd-aa29-4831-95fe-401b4528448c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:09.174652 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e3590bdd-aa29-4831-95fe-401b4528448c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:09.180605 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3590bdd-aa29-4831-95fe-401b4528448c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:09.181189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3590bdd-aa29-4831-95fe-401b4528448c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:09.181627 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3590bdd-aa29-4831-95fe-401b4528448c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:09.182311 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3590bdd-aa29-4831-95fe-401b4528448c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:09.183398 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3590bdd-aa29-4831-95fe-401b4528448c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:09.183825 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3590bdd-aa29-4831-95fe-401b4528448c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:09.212559 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3e63e3ad-ee13-4fff-8dc6-a48f2ce975e4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:09.213161 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3e63e3ad-ee13-4fff-8dc6-a48f2ce975e4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:09.219603 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3e63e3ad-ee13-4fff-8dc6-a48f2ce975e4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:09.220075 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3e63e3ad-ee13-4fff-8dc6-a48f2ce975e4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:09.220532 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3e63e3ad-ee13-4fff-8dc6-a48f2ce975e4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:09.221411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3e63e3ad-ee13-4fff-8dc6-a48f2ce975e4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:09.222028 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3e63e3ad-ee13-4fff-8dc6-a48f2ce975e4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:09.222474 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3e63e3ad-ee13-4fff-8dc6-a48f2ce975e4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:09.366353 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e3590bdd-aa29-4831-95fe-401b4528448c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:09.374814 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e3590bdd-aa29-4831-95fe-401b4528448c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.205057 Aug 24 16:49:09.375382 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 89/179] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:09 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:09.393245 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3e63e3ad-ee13-4fff-8dc6-a48f2ce975e4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:09.401211 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3e63e3ad-ee13-4fff-8dc6-a48f2ce975e4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:09.402829 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3e63e3ad-ee13-4fff-8dc6-a48f2ce975e4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:09.403929 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3e63e3ad-ee13-4fff-8dc6-a48f2ce975e4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.195304 Aug 24 16:49:09.404520 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 91/180] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:09 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:09.591877 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5c869c08-4714-4999-96de-fe189ed8e0bb tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:09.592653 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5c869c08-4714-4999-96de-fe189ed8e0bb tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:09.598795 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5c869c08-4714-4999-96de-fe189ed8e0bb tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:09.604202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5c869c08-4714-4999-96de-fe189ed8e0bb tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:09.604202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5c869c08-4714-4999-96de-fe189ed8e0bb tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:09.604202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5c869c08-4714-4999-96de-fe189ed8e0bb tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:09.605083 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8fd2951f-99c9-474c-8003-292a591a2718 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:09.605196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5c869c08-4714-4999-96de-fe189ed8e0bb tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:09.605196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5c869c08-4714-4999-96de-fe189ed8e0bb tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:09.605380 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8fd2951f-99c9-474c-8003-292a591a2718 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:09.607949 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8fd2951f-99c9-474c-8003-292a591a2718 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:09.608455 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8fd2951f-99c9-474c-8003-292a591a2718 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:09.608891 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8fd2951f-99c9-474c-8003-292a591a2718 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:09.609577 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8fd2951f-99c9-474c-8003-292a591a2718 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:09.610031 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8fd2951f-99c9-474c-8003-292a591a2718 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:09.610452 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8fd2951f-99c9-474c-8003-292a591a2718 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:09.785684 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5c869c08-4714-4999-96de-fe189ed8e0bb tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:09.794122 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5c869c08-4714-4999-96de-fe189ed8e0bb tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.206672 Aug 24 16:49:09.794682 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 90/181] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:09 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:09.796768 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8fd2951f-99c9-474c-8003-292a591a2718 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:09.804329 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8fd2951f-99c9-474c-8003-292a591a2718 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.207553 Aug 24 16:49:09.804949 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 92/182] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:09 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:10.395082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7a84c07d-dc63-4756-b410-8e950e2861cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:10.395698 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7a84c07d-dc63-4756-b410-8e950e2861cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:10.402136 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a84c07d-dc63-4756-b410-8e950e2861cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:10.402610 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a84c07d-dc63-4756-b410-8e950e2861cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:10.403039 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a84c07d-dc63-4756-b410-8e950e2861cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:10.403713 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a84c07d-dc63-4756-b410-8e950e2861cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:10.404162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a84c07d-dc63-4756-b410-8e950e2861cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:10.404613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a84c07d-dc63-4756-b410-8e950e2861cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:10.426363 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-88a40ede-f17c-4dbe-9e1f-5c7584d9b722 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:10.426963 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-88a40ede-f17c-4dbe-9e1f-5c7584d9b722 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:10.433349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88a40ede-f17c-4dbe-9e1f-5c7584d9b722 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:10.433836 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88a40ede-f17c-4dbe-9e1f-5c7584d9b722 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:10.434266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88a40ede-f17c-4dbe-9e1f-5c7584d9b722 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:10.434945 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88a40ede-f17c-4dbe-9e1f-5c7584d9b722 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:10.435457 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88a40ede-f17c-4dbe-9e1f-5c7584d9b722 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:10.436048 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88a40ede-f17c-4dbe-9e1f-5c7584d9b722 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:10.582677 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7a84c07d-dc63-4756-b410-8e950e2861cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:10.591771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7a84c07d-dc63-4756-b410-8e950e2861cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.200382 Aug 24 16:49:10.592623 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 91/183] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:10 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:10.608288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-88a40ede-f17c-4dbe-9e1f-5c7584d9b722 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:10.616558 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-88a40ede-f17c-4dbe-9e1f-5c7584d9b722 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:10.618326 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-88a40ede-f17c-4dbe-9e1f-5c7584d9b722 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:10.619419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-88a40ede-f17c-4dbe-9e1f-5c7584d9b722 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.196849 Aug 24 16:49:10.620040 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 93/184] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:10 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:10.815987 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1f6393c6-e02d-4f20-ba31-8e7cfe0f785d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:10.816658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1f6393c6-e02d-4f20-ba31-8e7cfe0f785d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:10.822900 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f6393c6-e02d-4f20-ba31-8e7cfe0f785d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:10.823889 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f6393c6-e02d-4f20-ba31-8e7cfe0f785d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:10.824322 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f6393c6-e02d-4f20-ba31-8e7cfe0f785d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:10.825042 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f6393c6-e02d-4f20-ba31-8e7cfe0f785d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:10.825495 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f6393c6-e02d-4f20-ba31-8e7cfe0f785d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:10.825917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f6393c6-e02d-4f20-ba31-8e7cfe0f785d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:10.826491 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c9506694-85e2-43f2-b1e7-a1df8b2c1c5d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:10.827217 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c9506694-85e2-43f2-b1e7-a1df8b2c1c5d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:10.833186 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c9506694-85e2-43f2-b1e7-a1df8b2c1c5d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:10.833671 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c9506694-85e2-43f2-b1e7-a1df8b2c1c5d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:10.834109 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c9506694-85e2-43f2-b1e7-a1df8b2c1c5d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:10.834847 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c9506694-85e2-43f2-b1e7-a1df8b2c1c5d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:10.835307 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c9506694-85e2-43f2-b1e7-a1df8b2c1c5d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:10.835732 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c9506694-85e2-43f2-b1e7-a1df8b2c1c5d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:11.013229 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1f6393c6-e02d-4f20-ba31-8e7cfe0f785d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:11.016265 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c9506694-85e2-43f2-b1e7-a1df8b2c1c5d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:11.023424 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1f6393c6-e02d-4f20-ba31-8e7cfe0f785d tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.211165 Aug 24 16:49:11.023808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c9506694-85e2-43f2-b1e7-a1df8b2c1c5d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.201998 Aug 24 16:49:11.024132 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 92/185] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:10 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:11.024376 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 94/186] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:10 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:11.613104 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ed7d289f-39f1-4039-bb2e-3de41610f421 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:11.613720 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ed7d289f-39f1-4039-bb2e-3de41610f421 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:11.620651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed7d289f-39f1-4039-bb2e-3de41610f421 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:11.621153 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed7d289f-39f1-4039-bb2e-3de41610f421 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:11.621578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed7d289f-39f1-4039-bb2e-3de41610f421 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:11.622281 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed7d289f-39f1-4039-bb2e-3de41610f421 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:11.622724 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed7d289f-39f1-4039-bb2e-3de41610f421 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:11.623136 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed7d289f-39f1-4039-bb2e-3de41610f421 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:11.638053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=100 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:11.642689 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c7b309e2-d1ce-4b12-8b78-ad2bcef77d5b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:11.643380 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c7b309e2-d1ce-4b12-8b78-ad2bcef77d5b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:11.649525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c7b309e2-d1ce-4b12-8b78-ad2bcef77d5b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:11.650015 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c7b309e2-d1ce-4b12-8b78-ad2bcef77d5b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:11.650454 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c7b309e2-d1ce-4b12-8b78-ad2bcef77d5b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:11.653228 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c7b309e2-d1ce-4b12-8b78-ad2bcef77d5b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:11.653228 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c7b309e2-d1ce-4b12-8b78-ad2bcef77d5b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:11.653228 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c7b309e2-d1ce-4b12-8b78-ad2bcef77d5b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:11.986808 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ed7d289f-39f1-4039-bb2e-3de41610f421 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:12.000092 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ed7d289f-39f1-4039-bb2e-3de41610f421 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.390727 Aug 24 16:49:12.000998 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 93/187] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:11 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:12.003524 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c7b309e2-d1ce-4b12-8b78-ad2bcef77d5b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:12.011582 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c7b309e2-d1ce-4b12-8b78-ad2bcef77d5b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:12.013104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c7b309e2-d1ce-4b12-8b78-ad2bcef77d5b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:12.014194 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c7b309e2-d1ce-4b12-8b78-ad2bcef77d5b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.375676 Aug 24 16:49:12.014744 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 95/188] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:11 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:12.044875 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-94d88fc5-1f3f-4a24-8f2e-f8cb69dc610e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:12.045088 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-68adb561-c270-4ae9-8d7c-a11cd60fb681 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:12.045560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-94d88fc5-1f3f-4a24-8f2e-f8cb69dc610e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:12.045717 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-68adb561-c270-4ae9-8d7c-a11cd60fb681 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:12.051453 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-68adb561-c270-4ae9-8d7c-a11cd60fb681 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:12.051595 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-94d88fc5-1f3f-4a24-8f2e-f8cb69dc610e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:12.051925 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-68adb561-c270-4ae9-8d7c-a11cd60fb681 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:12.052029 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-94d88fc5-1f3f-4a24-8f2e-f8cb69dc610e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:12.052425 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-68adb561-c270-4ae9-8d7c-a11cd60fb681 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:12.052540 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-94d88fc5-1f3f-4a24-8f2e-f8cb69dc610e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:12.053113 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-68adb561-c270-4ae9-8d7c-a11cd60fb681 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:12.053206 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-94d88fc5-1f3f-4a24-8f2e-f8cb69dc610e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:12.053558 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-68adb561-c270-4ae9-8d7c-a11cd60fb681 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:12.053654 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-94d88fc5-1f3f-4a24-8f2e-f8cb69dc610e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:12.053974 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-68adb561-c270-4ae9-8d7c-a11cd60fb681 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:12.054078 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-94d88fc5-1f3f-4a24-8f2e-f8cb69dc610e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:12.244606 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-68adb561-c270-4ae9-8d7c-a11cd60fb681 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:12.248264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-94d88fc5-1f3f-4a24-8f2e-f8cb69dc610e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:12.253332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-68adb561-c270-4ae9-8d7c-a11cd60fb681 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.212551 Aug 24 16:49:12.253913 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 96/189] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:12 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:12.256260 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-94d88fc5-1f3f-4a24-8f2e-f8cb69dc610e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.215721 Aug 24 16:49:12.256857 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 94/190] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:12 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:13.021784 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3373700a-2f2f-4c67-8190-cdd1582f346c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:13.022291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3373700a-2f2f-4c67-8190-cdd1582f346c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:13.029006 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3373700a-2f2f-4c67-8190-cdd1582f346c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:13.029497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3373700a-2f2f-4c67-8190-cdd1582f346c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:13.029929 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3373700a-2f2f-4c67-8190-cdd1582f346c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:13.030612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3373700a-2f2f-4c67-8190-cdd1582f346c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:13.031063 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3373700a-2f2f-4c67-8190-cdd1582f346c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:13.031482 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3373700a-2f2f-4c67-8190-cdd1582f346c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:13.037548 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7f82f1f0-fbd3-4882-8923-5501704fe833 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:13.038333 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7f82f1f0-fbd3-4882-8923-5501704fe833 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:13.044604 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f82f1f0-fbd3-4882-8923-5501704fe833 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:13.045091 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f82f1f0-fbd3-4882-8923-5501704fe833 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:13.045530 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f82f1f0-fbd3-4882-8923-5501704fe833 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:13.046256 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f82f1f0-fbd3-4882-8923-5501704fe833 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:13.046713 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f82f1f0-fbd3-4882-8923-5501704fe833 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:13.047138 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f82f1f0-fbd3-4882-8923-5501704fe833 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:13.226877 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3373700a-2f2f-4c67-8190-cdd1582f346c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:13.234793 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7f82f1f0-fbd3-4882-8923-5501704fe833 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:13.234974 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3373700a-2f2f-4c67-8190-cdd1582f346c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.216983 Aug 24 16:49:13.235415 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 97/191] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:13 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:13.241121 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7f82f1f0-fbd3-4882-8923-5501704fe833 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:13.242646 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7f82f1f0-fbd3-4882-8923-5501704fe833 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:13.244016 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7f82f1f0-fbd3-4882-8923-5501704fe833 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.210328 Aug 24 16:49:13.244734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 95/192] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:13 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:13.275420 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9ce6d761-b019-4e6e-ae7f-7f0708cbd380 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:13.275974 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9ce6d761-b019-4e6e-ae7f-7f0708cbd380 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:13.277042 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6b652cac-2cea-43a3-8b88-1ffaf951cce6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:13.277712 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6b652cac-2cea-43a3-8b88-1ffaf951cce6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:13.300220 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b652cac-2cea-43a3-8b88-1ffaf951cce6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:13.300395 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9ce6d761-b019-4e6e-ae7f-7f0708cbd380 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:13.300814 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b652cac-2cea-43a3-8b88-1ffaf951cce6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:13.300930 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9ce6d761-b019-4e6e-ae7f-7f0708cbd380 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:13.301247 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b652cac-2cea-43a3-8b88-1ffaf951cce6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:13.301356 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9ce6d761-b019-4e6e-ae7f-7f0708cbd380 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:13.301943 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b652cac-2cea-43a3-8b88-1ffaf951cce6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:13.302035 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9ce6d761-b019-4e6e-ae7f-7f0708cbd380 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:13.302395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b652cac-2cea-43a3-8b88-1ffaf951cce6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:13.302507 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9ce6d761-b019-4e6e-ae7f-7f0708cbd380 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:13.302817 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b652cac-2cea-43a3-8b88-1ffaf951cce6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:13.302913 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9ce6d761-b019-4e6e-ae7f-7f0708cbd380 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:13.493392 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9ce6d761-b019-4e6e-ae7f-7f0708cbd380 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:13.496595 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6b652cac-2cea-43a3-8b88-1ffaf951cce6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:13.501418 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9ce6d761-b019-4e6e-ae7f-7f0708cbd380 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.230942 Aug 24 16:49:13.502262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 98/193] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:13 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:13.504605 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6b652cac-2cea-43a3-8b88-1ffaf951cce6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.231912 Aug 24 16:49:13.505175 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 96/194] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:13 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:14.256732 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9d1abb6f-8dc0-47ab-9200-688153a4030c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:14.257346 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9d1abb6f-8dc0-47ab-9200-688153a4030c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:14.264103 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9d1abb6f-8dc0-47ab-9200-688153a4030c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:14.264628 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9d1abb6f-8dc0-47ab-9200-688153a4030c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:14.266811 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9d1abb6f-8dc0-47ab-9200-688153a4030c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:14.266811 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9d1abb6f-8dc0-47ab-9200-688153a4030c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:14.266811 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9d1abb6f-8dc0-47ab-9200-688153a4030c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:14.266811 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9d1abb6f-8dc0-47ab-9200-688153a4030c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:14.270918 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:14.274416 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9ca260c6-f0fc-419c-afaa-35ac97107666 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:14.275042 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9ca260c6-f0fc-419c-afaa-35ac97107666 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:14.282553 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ca260c6-f0fc-419c-afaa-35ac97107666 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:14.283043 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ca260c6-f0fc-419c-afaa-35ac97107666 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:14.283478 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ca260c6-f0fc-419c-afaa-35ac97107666 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:14.284349 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ca260c6-f0fc-419c-afaa-35ac97107666 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:14.284857 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ca260c6-f0fc-419c-afaa-35ac97107666 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:14.285287 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ca260c6-f0fc-419c-afaa-35ac97107666 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:14.491456 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9d1abb6f-8dc0-47ab-9200-688153a4030c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:14.495937 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9ca260c6-f0fc-419c-afaa-35ac97107666 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:14.499496 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9d1abb6f-8dc0-47ab-9200-688153a4030c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.246746 Aug 24 16:49:14.500469 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 99/195] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:14 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:14.505273 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9ca260c6-f0fc-419c-afaa-35ac97107666 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:14.507028 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9ca260c6-f0fc-419c-afaa-35ac97107666 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:14.508270 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9ca260c6-f0fc-419c-afaa-35ac97107666 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.244906 Aug 24 16:49:14.509168 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 97/196] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:14 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:14.524159 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b7acbc87-8d7c-4ce1-b735-93a5e2c432f2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:14.525015 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b7acbc87-8d7c-4ce1-b735-93a5e2c432f2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:14.532707 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-391cae96-d228-42c2-9cb4-c36454671151 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:14.532886 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7acbc87-8d7c-4ce1-b735-93a5e2c432f2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:14.533272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7acbc87-8d7c-4ce1-b735-93a5e2c432f2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:14.533383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-391cae96-d228-42c2-9cb4-c36454671151 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:14.533708 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7acbc87-8d7c-4ce1-b735-93a5e2c432f2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:14.534401 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7acbc87-8d7c-4ce1-b735-93a5e2c432f2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:14.535023 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7acbc87-8d7c-4ce1-b735-93a5e2c432f2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:14.535446 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7acbc87-8d7c-4ce1-b735-93a5e2c432f2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:14.539185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-391cae96-d228-42c2-9cb4-c36454671151 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:14.539673 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-391cae96-d228-42c2-9cb4-c36454671151 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:14.540106 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-391cae96-d228-42c2-9cb4-c36454671151 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:14.540836 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-391cae96-d228-42c2-9cb4-c36454671151 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:14.541288 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-391cae96-d228-42c2-9cb4-c36454671151 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:14.542270 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-391cae96-d228-42c2-9cb4-c36454671151 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:14.741776 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b7acbc87-8d7c-4ce1-b735-93a5e2c432f2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:14.745726 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-391cae96-d228-42c2-9cb4-c36454671151 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:14.753639 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b7acbc87-8d7c-4ce1-b735-93a5e2c432f2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.232183 Aug 24 16:49:14.753639 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 100/197] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:14 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:14.753891 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-391cae96-d228-42c2-9cb4-c36454671151 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.225011 Aug 24 16:49:14.754631 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 98/198] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:14 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:15.521958 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8032fe99-5fec-4874-bb3a-36f8d6c68d36 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:15.522608 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8032fe99-5fec-4874-bb3a-36f8d6c68d36 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:15.528668 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8032fe99-5fec-4874-bb3a-36f8d6c68d36 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:15.530317 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8032fe99-5fec-4874-bb3a-36f8d6c68d36 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:15.530317 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8032fe99-5fec-4874-bb3a-36f8d6c68d36 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:15.530317 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8032fe99-5fec-4874-bb3a-36f8d6c68d36 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:15.530696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8032fe99-5fec-4874-bb3a-36f8d6c68d36 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:15.531141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8032fe99-5fec-4874-bb3a-36f8d6c68d36 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:15.535398 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9f75b91c-d624-40b0-ae26-b7e3ccedae71 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:15.536009 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9f75b91c-d624-40b0-ae26-b7e3ccedae71 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:15.542507 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f75b91c-d624-40b0-ae26-b7e3ccedae71 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:15.543143 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f75b91c-d624-40b0-ae26-b7e3ccedae71 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:15.549190 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f75b91c-d624-40b0-ae26-b7e3ccedae71 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:15.549190 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f75b91c-d624-40b0-ae26-b7e3ccedae71 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:15.549190 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f75b91c-d624-40b0-ae26-b7e3ccedae71 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:15.549190 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f75b91c-d624-40b0-ae26-b7e3ccedae71 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:15.723368 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8032fe99-5fec-4874-bb3a-36f8d6c68d36 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:15.731747 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8032fe99-5fec-4874-bb3a-36f8d6c68d36 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.213560 Aug 24 16:49:15.732548 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 101/199] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:15 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:15.746613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9f75b91c-d624-40b0-ae26-b7e3ccedae71 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:15.754643 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9f75b91c-d624-40b0-ae26-b7e3ccedae71 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:15.756142 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9f75b91c-d624-40b0-ae26-b7e3ccedae71 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:15.757272 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9f75b91c-d624-40b0-ae26-b7e3ccedae71 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.225861 Aug 24 16:49:15.757840 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 99/200] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:15 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:15.777882 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2321a5a8-39f5-437a-85dc-816ce1bad491 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:15.778750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2321a5a8-39f5-437a-85dc-816ce1bad491 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:15.780980 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-89a4c7b6-09f8-4458-aa61-9f62a652b620 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:15.781652 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-89a4c7b6-09f8-4458-aa61-9f62a652b620 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:15.787966 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2321a5a8-39f5-437a-85dc-816ce1bad491 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:15.788350 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2321a5a8-39f5-437a-85dc-816ce1bad491 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:15.788987 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2321a5a8-39f5-437a-85dc-816ce1bad491 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:15.789689 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2321a5a8-39f5-437a-85dc-816ce1bad491 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:15.790316 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2321a5a8-39f5-437a-85dc-816ce1bad491 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:15.790746 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2321a5a8-39f5-437a-85dc-816ce1bad491 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:15.794135 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89a4c7b6-09f8-4458-aa61-9f62a652b620 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:15.794797 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89a4c7b6-09f8-4458-aa61-9f62a652b620 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:15.801687 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89a4c7b6-09f8-4458-aa61-9f62a652b620 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:15.801687 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89a4c7b6-09f8-4458-aa61-9f62a652b620 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:15.801687 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89a4c7b6-09f8-4458-aa61-9f62a652b620 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:15.801687 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89a4c7b6-09f8-4458-aa61-9f62a652b620 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:15.988604 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2321a5a8-39f5-437a-85dc-816ce1bad491 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:15.999125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2321a5a8-39f5-437a-85dc-816ce1bad491 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1314 microversion: 2.1 time: 0.224906 Aug 24 16:49:16.000255 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 100/201] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:15 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:16.003308 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-89a4c7b6-09f8-4458-aa61-9f62a652b620 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:16.012022 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-89a4c7b6-09f8-4458-aa61-9f62a652b620 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.234768 Aug 24 16:49:16.013022 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 102/202] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:15 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:16.753197 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f04e9c3a-ce3e-4ba3-8f50-d415633bbb45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:16.754550 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f04e9c3a-ce3e-4ba3-8f50-d415633bbb45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:16.762101 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04e9c3a-ce3e-4ba3-8f50-d415633bbb45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:16.762238 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04e9c3a-ce3e-4ba3-8f50-d415633bbb45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:16.762833 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04e9c3a-ce3e-4ba3-8f50-d415633bbb45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:16.763689 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04e9c3a-ce3e-4ba3-8f50-d415633bbb45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:16.764136 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04e9c3a-ce3e-4ba3-8f50-d415633bbb45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:16.764746 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04e9c3a-ce3e-4ba3-8f50-d415633bbb45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:16.779834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-176c01e4-3418-4e4d-a985-5e112031e1d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:16.781161 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-176c01e4-3418-4e4d-a985-5e112031e1d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:16.794369 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-176c01e4-3418-4e4d-a985-5e112031e1d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:16.794861 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-176c01e4-3418-4e4d-a985-5e112031e1d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:16.795297 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-176c01e4-3418-4e4d-a985-5e112031e1d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:16.796025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-176c01e4-3418-4e4d-a985-5e112031e1d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:16.796496 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-176c01e4-3418-4e4d-a985-5e112031e1d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:16.796926 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-176c01e4-3418-4e4d-a985-5e112031e1d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.004776 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f04e9c3a-ce3e-4ba3-8f50-d415633bbb45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:17.017942 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f04e9c3a-ce3e-4ba3-8f50-d415633bbb45 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.268046 Aug 24 16:49:17.018539 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 101/203] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:16 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:17.024312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5d7807f2-fed1-4209-836c-b89ab997e8aa tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:17.024959 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5d7807f2-fed1-4209-836c-b89ab997e8aa tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:17.031975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d7807f2-fed1-4209-836c-b89ab997e8aa tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.032487 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d7807f2-fed1-4209-836c-b89ab997e8aa tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.032930 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d7807f2-fed1-4209-836c-b89ab997e8aa tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.033633 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d7807f2-fed1-4209-836c-b89ab997e8aa tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.034103 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d7807f2-fed1-4209-836c-b89ab997e8aa tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.034500 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d7807f2-fed1-4209-836c-b89ab997e8aa tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.036907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-176c01e4-3418-4e4d-a985-5e112031e1d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:17.047456 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-176c01e4-3418-4e4d-a985-5e112031e1d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:17.049367 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-176c01e4-3418-4e4d-a985-5e112031e1d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:17.050508 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-176c01e4-3418-4e4d-a985-5e112031e1d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.275106 Aug 24 16:49:17.051545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 103/204] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:16 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:17.056550 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-71101c0c-666e-4b23-b888-10481a335bf3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:17.056981 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-71101c0c-666e-4b23-b888-10481a335bf3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:17.063009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-71101c0c-666e-4b23-b888-10481a335bf3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.063672 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-71101c0c-666e-4b23-b888-10481a335bf3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.064278 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-71101c0c-666e-4b23-b888-10481a335bf3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.065230 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-71101c0c-666e-4b23-b888-10481a335bf3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:17.065831 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-71101c0c-666e-4b23-b888-10481a335bf3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:17.066411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-71101c0c-666e-4b23-b888-10481a335bf3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:17.246388 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5d7807f2-fed1-4209-836c-b89ab997e8aa tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:17.255778 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5d7807f2-fed1-4209-836c-b89ab997e8aa tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1500 microversion: 2.1 time: 0.236047 Aug 24 16:49:17.257229 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 102/205] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:17 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1500 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:17.272638 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-71101c0c-666e-4b23-b888-10481a335bf3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:17.272638 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-71101c0c-666e-4b23-b888-10481a335bf3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.219598 Aug 24 16:49:17.273251 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 104/206] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:17 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:18.043387 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce3dfc14-284f-4501-a919-b27f3d647ed1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:18.044381 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ce3dfc14-284f-4501-a919-b27f3d647ed1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:18.058186 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce3dfc14-284f-4501-a919-b27f3d647ed1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:18.058800 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce3dfc14-284f-4501-a919-b27f3d647ed1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:18.059248 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce3dfc14-284f-4501-a919-b27f3d647ed1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:18.061170 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce3dfc14-284f-4501-a919-b27f3d647ed1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:18.061632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce3dfc14-284f-4501-a919-b27f3d647ed1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:18.062054 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce3dfc14-284f-4501-a919-b27f3d647ed1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:18.076294 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-39cd4395-3295-476b-9096-d50721894e02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:18.076894 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-39cd4395-3295-476b-9096-d50721894e02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:18.090155 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-39cd4395-3295-476b-9096-d50721894e02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:18.095032 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-39cd4395-3295-476b-9096-d50721894e02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:18.095545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-39cd4395-3295-476b-9096-d50721894e02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:18.096291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-39cd4395-3295-476b-9096-d50721894e02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:18.096784 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-39cd4395-3295-476b-9096-d50721894e02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:18.097236 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-39cd4395-3295-476b-9096-d50721894e02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:18.344185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-39cd4395-3295-476b-9096-d50721894e02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:18.351123 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ce3dfc14-284f-4501-a919-b27f3d647ed1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:18.357882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-39cd4395-3295-476b-9096-d50721894e02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:18.361533 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-39cd4395-3295-476b-9096-d50721894e02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:18.361533 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-39cd4395-3295-476b-9096-d50721894e02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.290480 Aug 24 16:49:18.361959 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ce3dfc14-284f-4501-a919-b27f3d647ed1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.323415 Aug 24 16:49:18.362040 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 105/207] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:18 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:18.362110 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 103/208] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:18 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:18.367346 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f7b3ab96-247f-432b-beb7-f7aa5c855322 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:18.368432 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f7b3ab96-247f-432b-beb7-f7aa5c855322 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:18.380690 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f7b3ab96-247f-432b-beb7-f7aa5c855322 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:18.381190 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f7b3ab96-247f-432b-beb7-f7aa5c855322 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:18.381628 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f7b3ab96-247f-432b-beb7-f7aa5c855322 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:18.382781 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f7b3ab96-247f-432b-beb7-f7aa5c855322 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:18.383694 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f7b3ab96-247f-432b-beb7-f7aa5c855322 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:18.384282 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f7b3ab96-247f-432b-beb7-f7aa5c855322 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:18.586093 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f7b3ab96-247f-432b-beb7-f7aa5c855322 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:18.599116 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f7b3ab96-247f-432b-beb7-f7aa5c855322 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.236240 Aug 24 16:49:18.600009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 106/209] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:18 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:19.386493 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9cf847df-12c2-40f0-a823-263b416b6dd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:19.387159 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9cf847df-12c2-40f0-a823-263b416b6dd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:19.390145 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-74aa3670-9a5c-4031-bdb1-608350e332b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:19.390760 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-74aa3670-9a5c-4031-bdb1-608350e332b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:19.401085 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-74aa3670-9a5c-4031-bdb1-608350e332b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:19.406479 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9cf847df-12c2-40f0-a823-263b416b6dd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:19.407557 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-74aa3670-9a5c-4031-bdb1-608350e332b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:19.408001 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-74aa3670-9a5c-4031-bdb1-608350e332b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:19.408821 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-74aa3670-9a5c-4031-bdb1-608350e332b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:19.409280 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-74aa3670-9a5c-4031-bdb1-608350e332b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:19.409703 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-74aa3670-9a5c-4031-bdb1-608350e332b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:19.413110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9cf847df-12c2-40f0-a823-263b416b6dd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:19.413553 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9cf847df-12c2-40f0-a823-263b416b6dd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:19.414284 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9cf847df-12c2-40f0-a823-263b416b6dd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:19.414732 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9cf847df-12c2-40f0-a823-263b416b6dd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:19.415307 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9cf847df-12c2-40f0-a823-263b416b6dd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:19.672726 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9cf847df-12c2-40f0-a823-263b416b6dd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:19.684280 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9cf847df-12c2-40f0-a823-263b416b6dd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:19.688750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9cf847df-12c2-40f0-a823-263b416b6dd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:19.690264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-74aa3670-9a5c-4031-bdb1-608350e332b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:19.692045 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9cf847df-12c2-40f0-a823-263b416b6dd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.309895 Aug 24 16:49:19.692842 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 107/210] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:19 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:19.699761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e1f77ef5-c831-41b4-abfe-40c3ba9d23c2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:19.700612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e1f77ef5-c831-41b4-abfe-40c3ba9d23c2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:19.708832 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e1f77ef5-c831-41b4-abfe-40c3ba9d23c2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:19.708832 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e1f77ef5-c831-41b4-abfe-40c3ba9d23c2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:19.708832 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e1f77ef5-c831-41b4-abfe-40c3ba9d23c2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:19.710415 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e1f77ef5-c831-41b4-abfe-40c3ba9d23c2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:19.711045 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e1f77ef5-c831-41b4-abfe-40c3ba9d23c2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:19.711660 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e1f77ef5-c831-41b4-abfe-40c3ba9d23c2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:19.722166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-74aa3670-9a5c-4031-bdb1-608350e332b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.344093 Aug 24 16:49:19.722759 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 104/211] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:19 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:19.958576 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e1f77ef5-c831-41b4-abfe-40c3ba9d23c2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:19.967498 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e1f77ef5-c831-41b4-abfe-40c3ba9d23c2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.273062 Aug 24 16:49:19.982398 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 108/212] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:19 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:20.200259 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0594095d-d9a0-4700-811d-6e6ae7e5e83c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a9841f6-7020-4eb1-a9c3-d4b5fa8a7078"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:20.200620 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-0b603c19-846c-4581-87dc-a073d0129456 req-372dd0ae-b8cc-4163-87a1-c4c16d4baf61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2cca9b-5df9-43a4-9791-633eab746eeb", "name": "network-vif-plugged", "status": "completed", "tag": "de8a2ec3-3c1d-4c19-9833-a7a754e2b815"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:20.214672 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-0b603c19-846c-4581-87dc-a073d0129456 req-372dd0ae-b8cc-4163-87a1-c4c16d4baf61 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.215164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-0b603c19-846c-4581-87dc-a073d0129456 req-372dd0ae-b8cc-4163-87a1-c4c16d4baf61 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.215784 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0594095d-d9a0-4700-811d-6e6ae7e5e83c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:20.215897 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-0b603c19-846c-4581-87dc-a073d0129456 req-372dd0ae-b8cc-4163-87a1-c4c16d4baf61 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.233095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0594095d-d9a0-4700-811d-6e6ae7e5e83c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.233823 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0594095d-d9a0-4700-811d-6e6ae7e5e83c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.234498 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0594095d-d9a0-4700-811d-6e6ae7e5e83c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.235885 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0594095d-d9a0-4700-811d-6e6ae7e5e83c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.237785 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0594095d-d9a0-4700-811d-6e6ae7e5e83c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.238617 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-0b603c19-846c-4581-87dc-a073d0129456 req-372dd0ae-b8cc-4163-87a1-c4c16d4baf61 service nova] Creating event network-vif-plugged:de8a2ec3-3c1d-4c19-9833-a7a754e2b815 for instance 6d2cca9b-5df9-43a4-9791-633eab746eeb on hv-cinder-85220 Aug 24 16:49:20.243056 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0594095d-d9a0-4700-811d-6e6ae7e5e83c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.249131 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-0b603c19-846c-4581-87dc-a073d0129456 req-372dd0ae-b8cc-4163-87a1-c4c16d4baf61 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057703 Aug 24 16:49:20.250350 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 105/213] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:20.720558 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-69a5c135-938a-4b5e-96f1-a5e4b3c9a3a4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:20.721280 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-69a5c135-938a-4b5e-96f1-a5e4b3c9a3a4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:20.727473 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69a5c135-938a-4b5e-96f1-a5e4b3c9a3a4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.727952 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69a5c135-938a-4b5e-96f1-a5e4b3c9a3a4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.728425 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69a5c135-938a-4b5e-96f1-a5e4b3c9a3a4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.729372 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69a5c135-938a-4b5e-96f1-a5e4b3c9a3a4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.729821 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69a5c135-938a-4b5e-96f1-a5e4b3c9a3a4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.730254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69a5c135-938a-4b5e-96f1-a5e4b3c9a3a4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.945457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-69a5c135-938a-4b5e-96f1-a5e4b3c9a3a4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:20.955658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-69a5c135-938a-4b5e-96f1-a5e4b3c9a3a4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:20.957245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-69a5c135-938a-4b5e-96f1-a5e4b3c9a3a4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:20.958496 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-69a5c135-938a-4b5e-96f1-a5e4b3c9a3a4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.242432 Aug 24 16:49:20.972202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 106/214] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:20 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:20.972202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6bd7cc5f-ca43-4012-ba36-ff10873273ce tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:20.972202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6bd7cc5f-ca43-4012-ba36-ff10873273ce tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:20.972992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6bd7cc5f-ca43-4012-ba36-ff10873273ce tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.973193 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6bd7cc5f-ca43-4012-ba36-ff10873273ce tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.973838 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6bd7cc5f-ca43-4012-ba36-ff10873273ce tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:20.974816 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6bd7cc5f-ca43-4012-ba36-ff10873273ce tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:20.975660 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6bd7cc5f-ca43-4012-ba36-ff10873273ce tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:20.976266 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6bd7cc5f-ca43-4012-ba36-ff10873273ce tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:21.186092 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6bd7cc5f-ca43-4012-ba36-ff10873273ce tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:21.194695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6bd7cc5f-ca43-4012-ba36-ff10873273ce tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.234189 Aug 24 16:49:21.195271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 107/215] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:20 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:21.200946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c6dd9c08-14ff-4e27-a888-9a6e387edfb1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:21.201956 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c6dd9c08-14ff-4e27-a888-9a6e387edfb1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:21.208243 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6dd9c08-14ff-4e27-a888-9a6e387edfb1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:21.208941 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6dd9c08-14ff-4e27-a888-9a6e387edfb1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:21.209382 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6dd9c08-14ff-4e27-a888-9a6e387edfb1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:21.210117 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6dd9c08-14ff-4e27-a888-9a6e387edfb1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:21.210575 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6dd9c08-14ff-4e27-a888-9a6e387edfb1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:21.211186 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6dd9c08-14ff-4e27-a888-9a6e387edfb1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:21.382272 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c6dd9c08-14ff-4e27-a888-9a6e387edfb1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:21.390613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c6dd9c08-14ff-4e27-a888-9a6e387edfb1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.193935 Aug 24 16:49:21.391332 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 108/216] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:21 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:21.607366 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0594095d-d9a0-4700-811d-6e6ae7e5e83c tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "POST /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.411347 Aug 24 16:49:21.612655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 109/217] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 16:49:20 2022] POST /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d/os-volume_attachments => generated 194 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:21.983579 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-988b36b1-821b-4b5f-9d0e-6fe5c0a58beb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:21.984190 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-988b36b1-821b-4b5f-9d0e-6fe5c0a58beb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:21.992193 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-988b36b1-821b-4b5f-9d0e-6fe5c0a58beb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:21.992987 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-988b36b1-821b-4b5f-9d0e-6fe5c0a58beb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:21.993426 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-988b36b1-821b-4b5f-9d0e-6fe5c0a58beb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:21.994118 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-988b36b1-821b-4b5f-9d0e-6fe5c0a58beb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:21.995129 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-988b36b1-821b-4b5f-9d0e-6fe5c0a58beb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:21.995552 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-988b36b1-821b-4b5f-9d0e-6fe5c0a58beb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.171724 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-988b36b1-821b-4b5f-9d0e-6fe5c0a58beb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:22.180314 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-988b36b1-821b-4b5f-9d0e-6fe5c0a58beb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:22.182391 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-988b36b1-821b-4b5f-9d0e-6fe5c0a58beb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:22.183759 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-988b36b1-821b-4b5f-9d0e-6fe5c0a58beb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.203943 Aug 24 16:49:22.184314 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 109/218] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:21 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:49:22.217144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-cc7ef6c6-feb5-4541-88d1-529ad0c438dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:22.217841 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-cc7ef6c6-feb5-4541-88d1-529ad0c438dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:22.224349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc7ef6c6-feb5-4541-88d1-529ad0c438dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.224856 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc7ef6c6-feb5-4541-88d1-529ad0c438dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.225287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc7ef6c6-feb5-4541-88d1-529ad0c438dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.225967 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc7ef6c6-feb5-4541-88d1-529ad0c438dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.226418 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc7ef6c6-feb5-4541-88d1-529ad0c438dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.226838 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc7ef6c6-feb5-4541-88d1-529ad0c438dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.335777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-0468ceec-9657-43be-b285-7a709a5820db req-1f4d9600-49dd-4238-9655-075a5a5a8b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff0a3b74-291b-4381-b945-50b48a823978", "name": "network-vif-plugged", "status": "completed", "tag": "83352098-6ea5-4bd7-aa7b-077d1f804efe"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:22.346875 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-0468ceec-9657-43be-b285-7a709a5820db req-1f4d9600-49dd-4238-9655-075a5a5a8b11 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.347445 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-0468ceec-9657-43be-b285-7a709a5820db req-1f4d9600-49dd-4238-9655-075a5a5a8b11 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.347944 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-0468ceec-9657-43be-b285-7a709a5820db req-1f4d9600-49dd-4238-9655-075a5a5a8b11 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.360782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-0468ceec-9657-43be-b285-7a709a5820db req-1f4d9600-49dd-4238-9655-075a5a5a8b11 service nova] Creating event network-vif-plugged:83352098-6ea5-4bd7-aa7b-077d1f804efe for instance ff0a3b74-291b-4381-b945-50b48a823978 on hv-cinder-85220 Aug 24 16:49:22.364694 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cc7ef6c6-feb5-4541-88d1-529ad0c438dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:22.365715 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-0468ceec-9657-43be-b285-7a709a5820db req-1f4d9600-49dd-4238-9655-075a5a5a8b11 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035783 Aug 24 16:49:22.366301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 110/219] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:49:22.373303 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-cc7ef6c6-feb5-4541-88d1-529ad0c438dc tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.160966 Aug 24 16:49:22.374104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 110/220] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:22 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:22.412322 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8b84acb4-180f-4387-96f0-1a596cfcd6e5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:22.412967 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8b84acb4-180f-4387-96f0-1a596cfcd6e5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:22.419686 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8b84acb4-180f-4387-96f0-1a596cfcd6e5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.420160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8b84acb4-180f-4387-96f0-1a596cfcd6e5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.420627 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8b84acb4-180f-4387-96f0-1a596cfcd6e5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.421321 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8b84acb4-180f-4387-96f0-1a596cfcd6e5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.421773 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8b84acb4-180f-4387-96f0-1a596cfcd6e5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.422189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8b84acb4-180f-4387-96f0-1a596cfcd6e5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.438990 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=100 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:22.572544 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8b84acb4-180f-4387-96f0-1a596cfcd6e5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:22.578446 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8b84acb4-180f-4387-96f0-1a596cfcd6e5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1321 microversion: 2.1 time: 0.170243 Aug 24 16:49:22.579183 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 111/221] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:22 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:23.211957 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-03b470ae-c95e-4212-a159-77853cd69650 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:23.211957 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-03b470ae-c95e-4212-a159-77853cd69650 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:23.219607 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-03b470ae-c95e-4212-a159-77853cd69650 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.219607 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-03b470ae-c95e-4212-a159-77853cd69650 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.219607 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-03b470ae-c95e-4212-a159-77853cd69650 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:23.219607 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-03b470ae-c95e-4212-a159-77853cd69650 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.220309 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-03b470ae-c95e-4212-a159-77853cd69650 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.220309 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-03b470ae-c95e-4212-a159-77853cd69650 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:23.361365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-03b470ae-c95e-4212-a159-77853cd69650 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:23.372593 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-03b470ae-c95e-4212-a159-77853cd69650 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:23.374115 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-03b470ae-c95e-4212-a159-77853cd69650 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:23.375234 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-03b470ae-c95e-4212-a159-77853cd69650 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1407 microversion: 2.20 time: 0.173327 Aug 24 16:49:23.375781 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 111/222] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:23 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:23.393563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4944d5f5-934e-4635-ba3a-c1b9a03ed439 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:23.394176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4944d5f5-934e-4635-ba3a-c1b9a03ed439 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:23.401002 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4944d5f5-934e-4635-ba3a-c1b9a03ed439 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.401484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4944d5f5-934e-4635-ba3a-c1b9a03ed439 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.401913 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4944d5f5-934e-4635-ba3a-c1b9a03ed439 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:23.402856 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4944d5f5-934e-4635-ba3a-c1b9a03ed439 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.403584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4944d5f5-934e-4635-ba3a-c1b9a03ed439 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.404209 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4944d5f5-934e-4635-ba3a-c1b9a03ed439 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:23.562875 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4944d5f5-934e-4635-ba3a-c1b9a03ed439 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:23.570777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4944d5f5-934e-4635-ba3a-c1b9a03ed439 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.181200 Aug 24 16:49:23.571940 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 112/223] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:23 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:23.599622 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-cc28039c-ed1d-4f18-a1f8-c0aa07afd7d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:23.600232 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-cc28039c-ed1d-4f18-a1f8-c0aa07afd7d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:23.606579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc28039c-ed1d-4f18-a1f8-c0aa07afd7d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.607066 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc28039c-ed1d-4f18-a1f8-c0aa07afd7d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.607502 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc28039c-ed1d-4f18-a1f8-c0aa07afd7d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:23.608184 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc28039c-ed1d-4f18-a1f8-c0aa07afd7d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.610723 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc28039c-ed1d-4f18-a1f8-c0aa07afd7d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.610723 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc28039c-ed1d-4f18-a1f8-c0aa07afd7d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:23.741181 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cc28039c-ed1d-4f18-a1f8-c0aa07afd7d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:23.749236 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-cc28039c-ed1d-4f18-a1f8-c0aa07afd7d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1516 microversion: 2.1 time: 0.153378 Aug 24 16:49:23.750354 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 112/224] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:23 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:23.779456 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-96d4055b-a592-4140-b7fd-f10fbd43410e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:23.781812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-96d4055b-a592-4140-b7fd-f10fbd43410e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:23.788079 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-96d4055b-a592-4140-b7fd-f10fbd43410e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.788603 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-96d4055b-a592-4140-b7fd-f10fbd43410e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.789038 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-96d4055b-a592-4140-b7fd-f10fbd43410e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:23.789807 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-96d4055b-a592-4140-b7fd-f10fbd43410e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:23.790179 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-96d4055b-a592-4140-b7fd-f10fbd43410e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:23.790599 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-96d4055b-a592-4140-b7fd-f10fbd43410e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:23.851683 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-96d4055b-a592-4140-b7fd-f10fbd43410e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lazy-loading 'flavor' on Instance uuid 5377571a-2ee1-4cb8-b47e-cd4f48808e8b {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:24.127804 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-740158620", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "networks": [{"uuid": "9d0c8cfb-12b0-4ae8-9a7d-4ccf80bf5709"}]}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:24.195139 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.network.neutron [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] validate_networks() for [('9d0c8cfb-12b0-4ae8-9a7d-4ccf80bf5709', None, None, None, None, None)] {{(pid=127715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:49:24.212687 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-96d4055b-a592-4140-b7fd-f10fbd43410e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "POST /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b/action" status: 200 len: 32 microversion: 2.1 time: 0.439444 Aug 24 16:49:24.214037 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 113/225] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 16:49:23 2022] POST /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b/action => generated 32 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:49:24.223516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6c67935b-e72c-4bec-8ed8-e50b27223c9a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:24.224219 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6c67935b-e72c-4bec-8ed8-e50b27223c9a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:24.230346 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c67935b-e72c-4bec-8ed8-e50b27223c9a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.230830 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c67935b-e72c-4bec-8ed8-e50b27223c9a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.231265 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c67935b-e72c-4bec-8ed8-e50b27223c9a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.232092 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c67935b-e72c-4bec-8ed8-e50b27223c9a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.232592 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c67935b-e72c-4bec-8ed8-e50b27223c9a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.233016 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c67935b-e72c-4bec-8ed8-e50b27223c9a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.500338 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6c67935b-e72c-4bec-8ed8-e50b27223c9a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:24.509758 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6c67935b-e72c-4bec-8ed8-e50b27223c9a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.289936 Aug 24 16:49:24.510540 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 114/226] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:24 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:24.517245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-498732d0-bda7-4eda-a9a4-beffb38c0c6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:24.517877 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-498732d0-bda7-4eda-a9a4-beffb38c0c6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:24.523588 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-498732d0-bda7-4eda-a9a4-beffb38c0c6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.524336 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-498732d0-bda7-4eda-a9a4-beffb38c0c6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.524815 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-498732d0-bda7-4eda-a9a4-beffb38c0c6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.526046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-498732d0-bda7-4eda-a9a4-beffb38c0c6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.526494 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-498732d0-bda7-4eda-a9a4-beffb38c0c6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.526916 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-498732d0-bda7-4eda-a9a4-beffb38c0c6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.731236 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-498732d0-bda7-4eda-a9a4-beffb38c0c6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:24.738561 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Flavor limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:49:24.739706 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Image limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:49:24.740287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Flavor pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:49:24.740911 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Image pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:49:24.741329 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:49:24.741445 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-498732d0-bda7-4eda-a9a4-beffb38c0c6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:24.743100 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-498732d0-bda7-4eda-a9a4-beffb38c0c6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:24.744303 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-498732d0-bda7-4eda-a9a4-beffb38c0c6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1598 microversion: 2.20 time: 0.232512 Aug 24 16:49:24.756482 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 115/227] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:49:24 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1598 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:49:24.760147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8c512a52-61eb-4ed0-b642-eda52ef9aa0a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:24.760737 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8c512a52-61eb-4ed0-b642-eda52ef9aa0a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:24.767449 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c512a52-61eb-4ed0-b642-eda52ef9aa0a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.768246 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c512a52-61eb-4ed0-b642-eda52ef9aa0a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.769097 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c512a52-61eb-4ed0-b642-eda52ef9aa0a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.769958 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c512a52-61eb-4ed0-b642-eda52ef9aa0a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.770575 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c512a52-61eb-4ed0-b642-eda52ef9aa0a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.771135 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c512a52-61eb-4ed0-b642-eda52ef9aa0a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.772462 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.772955 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.773587 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.774494 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.774995 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.775420 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.796082 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Getting quotas for project cd5a0fa1909747368101df31693c44e1. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:49:24.800629 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Getting quotas for user 55975de527254dca90fc4f30bc50e393 and project cd5a0fa1909747368101df31693c44e1. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:49:24.813075 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Going to run 1 instances... {{(pid=127715) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:49:24.815467 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:49:24.925005 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8c512a52-61eb-4ed0-b642-eda52ef9aa0a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:24.951260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c3a3250e-d3f1-42a0-88a4-c92c9c17948d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827937 Aug 24 16:49:24.953605 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 113/228] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:49:24.960282 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8c512a52-61eb-4ed0-b642-eda52ef9aa0a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.194421 Aug 24 16:49:24.961256 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5fa07f0e-5d09-41e8-bb86-1c69f461b3e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:24.962735 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5fa07f0e-5d09-41e8-bb86-1c69f461b3e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:24.963715 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 116/229] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:24 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:24.971066 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5fa07f0e-5d09-41e8-bb86-1c69f461b3e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.971738 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5fa07f0e-5d09-41e8-bb86-1c69f461b3e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.972709 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5fa07f0e-5d09-41e8-bb86-1c69f461b3e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.973739 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5fa07f0e-5d09-41e8-bb86-1c69f461b3e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.974369 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5fa07f0e-5d09-41e8-bb86-1c69f461b3e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.975005 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5fa07f0e-5d09-41e8-bb86-1c69f461b3e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.979331 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-70e65ade-2ae1-48ed-86b2-8f5b3175b79e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:24.983456 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-70e65ade-2ae1-48ed-86b2-8f5b3175b79e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:24.993845 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=100 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:25.057303 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-70e65ade-2ae1-48ed-86b2-8f5b3175b79e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:25.065922 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-70e65ade-2ae1-48ed-86b2-8f5b3175b79e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1213 microversion: 2.1 time: 0.101097 Aug 24 16:49:25.066628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 117/230] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:24 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:25.131204 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5fa07f0e-5d09-41e8-bb86-1c69f461b3e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.175952 Aug 24 16:49:25.131840 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 114/231] 10.222.0.70 () {60 vars in 1316 bytes} [Wed Aug 24 16:49:24 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:49:25.531961 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fe3f6c68-a102-473b-83a5-e7d763d2c5b6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:25.533687 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fe3f6c68-a102-473b-83a5-e7d763d2c5b6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:25.548016 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe3f6c68-a102-473b-83a5-e7d763d2c5b6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.548628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe3f6c68-a102-473b-83a5-e7d763d2c5b6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.549292 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe3f6c68-a102-473b-83a5-e7d763d2c5b6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.550077 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe3f6c68-a102-473b-83a5-e7d763d2c5b6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.550608 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe3f6c68-a102-473b-83a5-e7d763d2c5b6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.551098 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe3f6c68-a102-473b-83a5-e7d763d2c5b6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.845132 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fe3f6c68-a102-473b-83a5-e7d763d2c5b6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:25.857517 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fe3f6c68-a102-473b-83a5-e7d763d2c5b6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.329181 Aug 24 16:49:25.858411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 118/232] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:25 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:25.983872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-534249c7-4dd9-413c-8ac0-9b001c5e11c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:25.985166 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-534249c7-4dd9-413c-8ac0-9b001c5e11c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:25.993565 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-534249c7-4dd9-413c-8ac0-9b001c5e11c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.994847 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-534249c7-4dd9-413c-8ac0-9b001c5e11c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.995499 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-534249c7-4dd9-413c-8ac0-9b001c5e11c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.996430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-534249c7-4dd9-413c-8ac0-9b001c5e11c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.997094 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-534249c7-4dd9-413c-8ac0-9b001c5e11c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.997719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-534249c7-4dd9-413c-8ac0-9b001c5e11c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.021552 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:26.092457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bcbd890b-6122-4c01-b3d2-51fb8d0f0b2f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:26.093082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bcbd890b-6122-4c01-b3d2-51fb8d0f0b2f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:26.248300 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bcbd890b-6122-4c01-b3d2-51fb8d0f0b2f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:26.257989 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bcbd890b-6122-4c01-b3d2-51fb8d0f0b2f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1213 microversion: 2.1 time: 0.170157 Aug 24 16:49:26.258800 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 119/233] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:26 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1213 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:26.308601 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-534249c7-4dd9-413c-8ac0-9b001c5e11c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:26.338496 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-534249c7-4dd9-413c-8ac0-9b001c5e11c5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.359040 Aug 24 16:49:26.339144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 115/234] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:25 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:26.879651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-17e2ec54-f135-45bc-b758-fe65d6e658ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:26.880650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-17e2ec54-f135-45bc-b758-fe65d6e658ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:26.888503 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-20cf4dfe-7ad3-4fd2-9a63-0a20f3d00d9b req-f6dc0ffc-0694-44e4-a155-7b53ea6727d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2cca9b-5df9-43a4-9791-633eab746eeb", "tag": "de8a2ec3-3c1d-4c19-9833-a7a754e2b815"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:26.890572 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17e2ec54-f135-45bc-b758-fe65d6e658ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.893040 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17e2ec54-f135-45bc-b758-fe65d6e658ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.893685 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17e2ec54-f135-45bc-b758-fe65d6e658ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.894586 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17e2ec54-f135-45bc-b758-fe65d6e658ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.898781 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17e2ec54-f135-45bc-b758-fe65d6e658ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.899482 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17e2ec54-f135-45bc-b758-fe65d6e658ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.900305 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-20cf4dfe-7ad3-4fd2-9a63-0a20f3d00d9b req-f6dc0ffc-0694-44e4-a155-7b53ea6727d0 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.901537 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-20cf4dfe-7ad3-4fd2-9a63-0a20f3d00d9b req-f6dc0ffc-0694-44e4-a155-7b53ea6727d0 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.908364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-20cf4dfe-7ad3-4fd2-9a63-0a20f3d00d9b req-f6dc0ffc-0694-44e4-a155-7b53ea6727d0 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.918806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-20cf4dfe-7ad3-4fd2-9a63-0a20f3d00d9b req-f6dc0ffc-0694-44e4-a155-7b53ea6727d0 service nova] Creating event network-changed:de8a2ec3-3c1d-4c19-9833-a7a754e2b815 for instance 6d2cca9b-5df9-43a4-9791-633eab746eeb on hv-cinder-85220 Aug 24 16:49:26.925297 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-20cf4dfe-7ad3-4fd2-9a63-0a20f3d00d9b req-f6dc0ffc-0694-44e4-a155-7b53ea6727d0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042061 Aug 24 16:49:26.926053 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 116/235] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:27.129477 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-17e2ec54-f135-45bc-b758-fe65d6e658ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:27.142540 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-17e2ec54-f135-45bc-b758-fe65d6e658ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.266921 Aug 24 16:49:27.143621 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 120/236] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:26 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:27.280743 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7aea53e4-c490-44e3-b212-987c3abc12e8 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:27.284199 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7aea53e4-c490-44e3-b212-987c3abc12e8 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:27.295559 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7aea53e4-c490-44e3-b212-987c3abc12e8 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:27.296098 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7aea53e4-c490-44e3-b212-987c3abc12e8 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:27.296573 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7aea53e4-c490-44e3-b212-987c3abc12e8 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:27.297540 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7aea53e4-c490-44e3-b212-987c3abc12e8 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:27.298155 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7aea53e4-c490-44e3-b212-987c3abc12e8 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:27.298746 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7aea53e4-c490-44e3-b212-987c3abc12e8 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:27.368805 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-06c85008-3cad-47ca-aa26-fea65dad176d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:27.369213 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7aea53e4-c490-44e3-b212-987c3abc12e8 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:27.369511 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-06c85008-3cad-47ca-aa26-fea65dad176d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:27.375676 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06c85008-3cad-47ca-aa26-fea65dad176d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:27.376154 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06c85008-3cad-47ca-aa26-fea65dad176d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:27.376722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06c85008-3cad-47ca-aa26-fea65dad176d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:27.377436 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06c85008-3cad-47ca-aa26-fea65dad176d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:27.382139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06c85008-3cad-47ca-aa26-fea65dad176d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:27.382139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06c85008-3cad-47ca-aa26-fea65dad176d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:27.382338 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7aea53e4-c490-44e3-b212-987c3abc12e8 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1217 microversion: 2.1 time: 0.104470 Aug 24 16:49:27.382338 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 117/237] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:27 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:27.576196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-06c85008-3cad-47ca-aa26-fea65dad176d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:27.589521 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-06c85008-3cad-47ca-aa26-fea65dad176d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1367 microversion: 2.1 time: 0.227352 Aug 24 16:49:27.591187 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 121/238] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:27 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:28.167992 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8c2a4590-eaf0-4943-b566-35ca5e3a1a0b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:28.168644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8c2a4590-eaf0-4943-b566-35ca5e3a1a0b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:28.174661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8c2a4590-eaf0-4943-b566-35ca5e3a1a0b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:28.175235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8c2a4590-eaf0-4943-b566-35ca5e3a1a0b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:28.175683 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8c2a4590-eaf0-4943-b566-35ca5e3a1a0b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:28.176385 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8c2a4590-eaf0-4943-b566-35ca5e3a1a0b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:28.176954 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8c2a4590-eaf0-4943-b566-35ca5e3a1a0b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:28.177384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8c2a4590-eaf0-4943-b566-35ca5e3a1a0b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:28.341526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8c2a4590-eaf0-4943-b566-35ca5e3a1a0b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:28.357093 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8c2a4590-eaf0-4943-b566-35ca5e3a1a0b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.193195 Aug 24 16:49:28.357685 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 118/239] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:28 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:28.404203 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0df7345d-001c-47bf-803d-caa3d6bbf3d5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:28.404879 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0df7345d-001c-47bf-803d-caa3d6bbf3d5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:28.411015 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0df7345d-001c-47bf-803d-caa3d6bbf3d5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:28.411917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0df7345d-001c-47bf-803d-caa3d6bbf3d5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:28.412538 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0df7345d-001c-47bf-803d-caa3d6bbf3d5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:28.413383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0df7345d-001c-47bf-803d-caa3d6bbf3d5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:28.413995 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0df7345d-001c-47bf-803d-caa3d6bbf3d5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:28.414912 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0df7345d-001c-47bf-803d-caa3d6bbf3d5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:28.480863 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0df7345d-001c-47bf-803d-caa3d6bbf3d5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:28.489376 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0df7345d-001c-47bf-803d-caa3d6bbf3d5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1209 microversion: 2.1 time: 0.090689 Aug 24 16:49:28.490205 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 122/240] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:28 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:28.614878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6866c201-3839-4336-9842-4246151f536d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:28.615403 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6866c201-3839-4336-9842-4246151f536d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:28.623803 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6866c201-3839-4336-9842-4246151f536d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:28.624734 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6866c201-3839-4336-9842-4246151f536d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:28.625322 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6866c201-3839-4336-9842-4246151f536d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:28.626397 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6866c201-3839-4336-9842-4246151f536d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:28.626891 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6866c201-3839-4336-9842-4246151f536d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:28.627501 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6866c201-3839-4336-9842-4246151f536d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:28.784553 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6866c201-3839-4336-9842-4246151f536d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:28.792824 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6866c201-3839-4336-9842-4246151f536d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1556 microversion: 2.1 time: 0.183532 Aug 24 16:49:28.793573 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 119/241] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:28 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1556 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:28.814480 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0bb715cd-c8f8-4dcb-b19e-90a8242350b1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:28.814973 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0bb715cd-c8f8-4dcb-b19e-90a8242350b1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:28.823069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0bb715cd-c8f8-4dcb-b19e-90a8242350b1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:28.823069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0bb715cd-c8f8-4dcb-b19e-90a8242350b1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:28.823069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0bb715cd-c8f8-4dcb-b19e-90a8242350b1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:28.823069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0bb715cd-c8f8-4dcb-b19e-90a8242350b1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:28.823432 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0bb715cd-c8f8-4dcb-b19e-90a8242350b1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:28.823432 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0bb715cd-c8f8-4dcb-b19e-90a8242350b1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:28.913651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0bb715cd-c8f8-4dcb-b19e-90a8242350b1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102947 Aug 24 16:49:28.914518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 123/242] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Aug 24 16:49:28 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:29.379190 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-97d696ad-119b-4e3e-9ab5-854d0405d94e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:29.380145 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-97d696ad-119b-4e3e-9ab5-854d0405d94e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:29.389109 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-97d696ad-119b-4e3e-9ab5-854d0405d94e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:29.390575 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-97d696ad-119b-4e3e-9ab5-854d0405d94e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:29.391188 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-97d696ad-119b-4e3e-9ab5-854d0405d94e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:29.393188 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-97d696ad-119b-4e3e-9ab5-854d0405d94e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:29.393928 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-97d696ad-119b-4e3e-9ab5-854d0405d94e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:29.395862 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-97d696ad-119b-4e3e-9ab5-854d0405d94e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:29.513069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4e0c655c-e36b-4e11-b37f-78f7b0673e66 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:29.513736 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4e0c655c-e36b-4e11-b37f-78f7b0673e66 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:29.532668 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e0c655c-e36b-4e11-b37f-78f7b0673e66 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:29.535700 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e0c655c-e36b-4e11-b37f-78f7b0673e66 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:29.537617 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e0c655c-e36b-4e11-b37f-78f7b0673e66 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:29.539178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e0c655c-e36b-4e11-b37f-78f7b0673e66 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:29.539797 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e0c655c-e36b-4e11-b37f-78f7b0673e66 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:29.542074 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e0c655c-e36b-4e11-b37f-78f7b0673e66 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:29.656551 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-97d696ad-119b-4e3e-9ab5-854d0405d94e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:29.656688 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4e0c655c-e36b-4e11-b37f-78f7b0673e66 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:29.665540 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-97d696ad-119b-4e3e-9ab5-854d0405d94e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.289337 Aug 24 16:49:29.666848 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4e0c655c-e36b-4e11-b37f-78f7b0673e66 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1273 microversion: 2.1 time: 0.156926 Aug 24 16:49:29.667598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 120/243] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:29 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:29.668085 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 124/244] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:29 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:30.687828 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0c16b2f4-0ae5-4bb9-ac85-1f69768c0527 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:30.688453 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0c16b2f4-0ae5-4bb9-ac85-1f69768c0527 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:30.691423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e99c7c93-0b02-4c36-8852-5fbb17bdc138 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:30.692491 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e99c7c93-0b02-4c36-8852-5fbb17bdc138 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:30.695675 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0c16b2f4-0ae5-4bb9-ac85-1f69768c0527 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:30.696248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0c16b2f4-0ae5-4bb9-ac85-1f69768c0527 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:30.696805 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0c16b2f4-0ae5-4bb9-ac85-1f69768c0527 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:30.698298 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0c16b2f4-0ae5-4bb9-ac85-1f69768c0527 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:30.698810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0c16b2f4-0ae5-4bb9-ac85-1f69768c0527 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:30.699143 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e99c7c93-0b02-4c36-8852-5fbb17bdc138 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:30.699306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0c16b2f4-0ae5-4bb9-ac85-1f69768c0527 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:30.699739 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e99c7c93-0b02-4c36-8852-5fbb17bdc138 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:30.700053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e99c7c93-0b02-4c36-8852-5fbb17bdc138 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:30.700894 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e99c7c93-0b02-4c36-8852-5fbb17bdc138 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:30.701347 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e99c7c93-0b02-4c36-8852-5fbb17bdc138 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:30.701775 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e99c7c93-0b02-4c36-8852-5fbb17bdc138 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:30.798998 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e99c7c93-0b02-4c36-8852-5fbb17bdc138 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:30.807484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e99c7c93-0b02-4c36-8852-5fbb17bdc138 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1271 microversion: 2.1 time: 0.119756 Aug 24 16:49:30.808044 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 125/245] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:30 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:30.898027 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0c16b2f4-0ae5-4bb9-ac85-1f69768c0527 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:30.920649 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0c16b2f4-0ae5-4bb9-ac85-1f69768c0527 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.236427 Aug 24 16:49:30.923246 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 121/246] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:30 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:30.955955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-fcb01f8f-c27d-4be0-bbeb-d47d07ac6780 req-5889181b-fcb4-4c88-ab57-921296c9cdbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff0a3b74-291b-4381-b945-50b48a823978", "tag": "83352098-6ea5-4bd7-aa7b-077d1f804efe"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:30.966360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-fcb01f8f-c27d-4be0-bbeb-d47d07ac6780 req-5889181b-fcb4-4c88-ab57-921296c9cdbe service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:30.966865 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-fcb01f8f-c27d-4be0-bbeb-d47d07ac6780 req-5889181b-fcb4-4c88-ab57-921296c9cdbe service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:30.967289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-fcb01f8f-c27d-4be0-bbeb-d47d07ac6780 req-5889181b-fcb4-4c88-ab57-921296c9cdbe service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:30.978525 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-fcb01f8f-c27d-4be0-bbeb-d47d07ac6780 req-5889181b-fcb4-4c88-ab57-921296c9cdbe service nova] Creating event network-changed:83352098-6ea5-4bd7-aa7b-077d1f804efe for instance ff0a3b74-291b-4381-b945-50b48a823978 on hv-cinder-85220 Aug 24 16:49:30.984070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-fcb01f8f-c27d-4be0-bbeb-d47d07ac6780 req-5889181b-fcb4-4c88-ab57-921296c9cdbe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032453 Aug 24 16:49:30.984765 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 126/247] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:31.837325 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4c81a7d2-024b-40a0-ba90-67f50dadd748 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:31.838126 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4c81a7d2-024b-40a0-ba90-67f50dadd748 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:31.845906 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4c81a7d2-024b-40a0-ba90-67f50dadd748 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:31.846482 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4c81a7d2-024b-40a0-ba90-67f50dadd748 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:31.846903 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4c81a7d2-024b-40a0-ba90-67f50dadd748 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:31.847610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4c81a7d2-024b-40a0-ba90-67f50dadd748 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:31.848128 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4c81a7d2-024b-40a0-ba90-67f50dadd748 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:31.848484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4c81a7d2-024b-40a0-ba90-67f50dadd748 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:31.946697 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ba8def0b-9219-4cd5-b498-b6484d25da57 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:31.947406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ba8def0b-9219-4cd5-b498-b6484d25da57 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:31.956727 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8def0b-9219-4cd5-b498-b6484d25da57 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:31.957218 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8def0b-9219-4cd5-b498-b6484d25da57 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:31.957650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8def0b-9219-4cd5-b498-b6484d25da57 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:31.958348 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8def0b-9219-4cd5-b498-b6484d25da57 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:31.958793 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8def0b-9219-4cd5-b498-b6484d25da57 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:31.959209 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8def0b-9219-4cd5-b498-b6484d25da57 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.065423 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4c81a7d2-024b-40a0-ba90-67f50dadd748 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:32.080684 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4c81a7d2-024b-40a0-ba90-67f50dadd748 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1313 microversion: 2.1 time: 0.247707 Aug 24 16:49:32.093009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 122/248] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:31 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:32.138949 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ba8def0b-9219-4cd5-b498-b6484d25da57 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:32.147965 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ba8def0b-9219-4cd5-b498-b6484d25da57 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.207930 Aug 24 16:49:32.148574 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 127/249] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:31 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:33.105999 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2b205289-c818-4dcb-a384-d86dfcc28dfc tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:33.106614 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2b205289-c818-4dcb-a384-d86dfcc28dfc tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:33.113254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b205289-c818-4dcb-a384-d86dfcc28dfc tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:33.113747 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b205289-c818-4dcb-a384-d86dfcc28dfc tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:33.114190 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b205289-c818-4dcb-a384-d86dfcc28dfc tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:33.114887 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b205289-c818-4dcb-a384-d86dfcc28dfc tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:33.115341 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b205289-c818-4dcb-a384-d86dfcc28dfc tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:33.115766 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b205289-c818-4dcb-a384-d86dfcc28dfc tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:33.171009 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e95e233c-2d5b-4ec6-983c-bc6e7f167a2a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:33.171678 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e95e233c-2d5b-4ec6-983c-bc6e7f167a2a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:33.178738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e95e233c-2d5b-4ec6-983c-bc6e7f167a2a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:33.179233 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e95e233c-2d5b-4ec6-983c-bc6e7f167a2a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:33.179663 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e95e233c-2d5b-4ec6-983c-bc6e7f167a2a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:33.180372 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e95e233c-2d5b-4ec6-983c-bc6e7f167a2a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:33.180989 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e95e233c-2d5b-4ec6-983c-bc6e7f167a2a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:33.181422 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e95e233c-2d5b-4ec6-983c-bc6e7f167a2a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:33.274149 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2b205289-c818-4dcb-a384-d86dfcc28dfc tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:33.282343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2b205289-c818-4dcb-a384-d86dfcc28dfc tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1313 microversion: 2.1 time: 0.180797 Aug 24 16:49:33.283055 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 123/250] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:33 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:33.370565 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e95e233c-2d5b-4ec6-983c-bc6e7f167a2a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:33.382764 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e95e233c-2d5b-4ec6-983c-bc6e7f167a2a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.217347 Aug 24 16:49:33.395750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 128/251] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:33 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:33.682152 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-f8f474a9-526c-4ce0-9773-661694b107f6 req-30c8c215-eaf6-46d0-b56e-ccab481c5f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83281073-e14a-4f29-a571-42e2956de57a", "tag": "d95e5213-a1b0-476a-b4ad-73a209306cef"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:33.692365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f8f474a9-526c-4ce0-9773-661694b107f6 req-30c8c215-eaf6-46d0-b56e-ccab481c5f7a service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:33.693290 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f8f474a9-526c-4ce0-9773-661694b107f6 req-30c8c215-eaf6-46d0-b56e-ccab481c5f7a service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:33.693858 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f8f474a9-526c-4ce0-9773-661694b107f6 req-30c8c215-eaf6-46d0-b56e-ccab481c5f7a service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:33.708348 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-f8f474a9-526c-4ce0-9773-661694b107f6 req-30c8c215-eaf6-46d0-b56e-ccab481c5f7a service nova] Creating event network-changed:d95e5213-a1b0-476a-b4ad-73a209306cef for instance 83281073-e14a-4f29-a571-42e2956de57a on hv-cinder-85220 Aug 24 16:49:33.715384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-f8f474a9-526c-4ce0-9773-661694b107f6 req-30c8c215-eaf6-46d0-b56e-ccab481c5f7a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036791 Aug 24 16:49:33.716799 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 124/252] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:34.303128 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-33e1783f-6755-4bac-a6e4-7aaeb9994da6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:34.303751 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-33e1783f-6755-4bac-a6e4-7aaeb9994da6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:34.310815 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33e1783f-6755-4bac-a6e4-7aaeb9994da6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:34.311309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33e1783f-6755-4bac-a6e4-7aaeb9994da6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:34.311742 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33e1783f-6755-4bac-a6e4-7aaeb9994da6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:34.312481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33e1783f-6755-4bac-a6e4-7aaeb9994da6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:34.312939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33e1783f-6755-4bac-a6e4-7aaeb9994da6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:34.313362 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33e1783f-6755-4bac-a6e4-7aaeb9994da6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:34.318123 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:34.408344 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-935ffcb9-8d8c-4e0c-9f84-83bd712381a2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:34.410117 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-935ffcb9-8d8c-4e0c-9f84-83bd712381a2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:34.421866 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:34.425051 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-935ffcb9-8d8c-4e0c-9f84-83bd712381a2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:34.425580 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-935ffcb9-8d8c-4e0c-9f84-83bd712381a2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:34.426031 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-935ffcb9-8d8c-4e0c-9f84-83bd712381a2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:34.426754 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-935ffcb9-8d8c-4e0c-9f84-83bd712381a2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:34.427210 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-935ffcb9-8d8c-4e0c-9f84-83bd712381a2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:34.427643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-935ffcb9-8d8c-4e0c-9f84-83bd712381a2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:34.784534 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:34.797176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-33e1783f-6755-4bac-a6e4-7aaeb9994da6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:34.805920 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-33e1783f-6755-4bac-a6e4-7aaeb9994da6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1313 microversion: 2.1 time: 0.506644 Aug 24 16:49:34.806108 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-935ffcb9-8d8c-4e0c-9f84-83bd712381a2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:34.806509 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 129/253] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:34 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:34.810128 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=6 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:34.816600 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-935ffcb9-8d8c-4e0c-9f84-83bd712381a2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.412835 Aug 24 16:49:34.817183 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 125/254] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:34 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:35.107345 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4c704713-ccf7-48dc-8582-46d219ab6ba6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:35.108209 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4c704713-ccf7-48dc-8582-46d219ab6ba6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:35.114524 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c704713-ccf7-48dc-8582-46d219ab6ba6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.115175 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c704713-ccf7-48dc-8582-46d219ab6ba6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.115614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c704713-ccf7-48dc-8582-46d219ab6ba6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.116314 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c704713-ccf7-48dc-8582-46d219ab6ba6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.116804 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c704713-ccf7-48dc-8582-46d219ab6ba6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.117223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c704713-ccf7-48dc-8582-46d219ab6ba6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.154211 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4c704713-ccf7-48dc-8582-46d219ab6ba6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:49:35.516884 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4c704713-ccf7-48dc-8582-46d219ab6ba6 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "DELETE /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 204 len: 0 microversion: 2.1 time: 0.413718 Aug 24 16:49:35.517662 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 130/255] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:49:35 2022] DELETE /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:35.527986 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-cb58fcf0-ebdb-4343-8292-423e8d478576 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:35.528768 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-cb58fcf0-ebdb-4343-8292-423e8d478576 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:35.543683 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb58fcf0-ebdb-4343-8292-423e8d478576 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.549617 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb58fcf0-ebdb-4343-8292-423e8d478576 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.551277 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb58fcf0-ebdb-4343-8292-423e8d478576 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.552028 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb58fcf0-ebdb-4343-8292-423e8d478576 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.552557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb58fcf0-ebdb-4343-8292-423e8d478576 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.552955 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb58fcf0-ebdb-4343-8292-423e8d478576 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.701497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cb58fcf0-ebdb-4343-8292-423e8d478576 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:35.709793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-cb58fcf0-ebdb-4343-8292-423e8d478576 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1552 microversion: 2.1 time: 0.187353 Aug 24 16:49:35.710458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 126/256] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:35 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1552 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:35.828639 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6c939dea-572c-4d18-ac57-ab0d3c85aeda tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:35.829700 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6c939dea-572c-4d18-ac57-ab0d3c85aeda tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:35.840674 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c939dea-572c-4d18-ac57-ab0d3c85aeda tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.841078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ea58b67e-6be0-4f44-be70-aaf237fe813a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:35.841416 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c939dea-572c-4d18-ac57-ab0d3c85aeda tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.841687 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ea58b67e-6be0-4f44-be70-aaf237fe813a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:35.842907 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c939dea-572c-4d18-ac57-ab0d3c85aeda tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.843632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c939dea-572c-4d18-ac57-ab0d3c85aeda tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.844088 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c939dea-572c-4d18-ac57-ab0d3c85aeda tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.844731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c939dea-572c-4d18-ac57-ab0d3c85aeda tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.848390 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ea58b67e-6be0-4f44-be70-aaf237fe813a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.849001 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ea58b67e-6be0-4f44-be70-aaf237fe813a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.849426 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ea58b67e-6be0-4f44-be70-aaf237fe813a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.850132 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ea58b67e-6be0-4f44-be70-aaf237fe813a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.850568 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ea58b67e-6be0-4f44-be70-aaf237fe813a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.851097 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ea58b67e-6be0-4f44-be70-aaf237fe813a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.101665 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6c939dea-572c-4d18-ac57-ab0d3c85aeda tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:36.111284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6c939dea-572c-4d18-ac57-ab0d3c85aeda tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1313 microversion: 2.1 time: 0.287338 Aug 24 16:49:36.111886 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 131/257] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:35 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:36.114164 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ea58b67e-6be0-4f44-be70-aaf237fe813a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:36.124091 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ea58b67e-6be0-4f44-be70-aaf237fe813a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.287787 Aug 24 16:49:36.124707 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 127/258] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:35 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:36.731312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-df9f7839-7f51-4b5e-a679-618fe633c79e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:36.732227 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-df9f7839-7f51-4b5e-a679-618fe633c79e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:36.734715 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=4 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:36.746040 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df9f7839-7f51-4b5e-a679-618fe633c79e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.746527 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df9f7839-7f51-4b5e-a679-618fe633c79e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.746949 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df9f7839-7f51-4b5e-a679-618fe633c79e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.747652 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df9f7839-7f51-4b5e-a679-618fe633c79e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.748148 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df9f7839-7f51-4b5e-a679-618fe633c79e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.748611 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df9f7839-7f51-4b5e-a679-618fe633c79e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.895641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-df9f7839-7f51-4b5e-a679-618fe633c79e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:36.904686 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-df9f7839-7f51-4b5e-a679-618fe633c79e tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1552 microversion: 2.1 time: 0.178157 Aug 24 16:49:36.905262 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 132/259] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:36 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:37.144330 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-37b2d710-8d55-42ac-89a9-2b6ed11c0a95 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:37.144967 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-37b2d710-8d55-42ac-89a9-2b6ed11c0a95 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:37.152335 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-37b2d710-8d55-42ac-89a9-2b6ed11c0a95 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.152864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-37b2d710-8d55-42ac-89a9-2b6ed11c0a95 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.153308 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-37b2d710-8d55-42ac-89a9-2b6ed11c0a95 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.153844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b7cc22b5-cc38-484a-8404-edbd1a8a3bc3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:37.154020 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-37b2d710-8d55-42ac-89a9-2b6ed11c0a95 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.154475 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-37b2d710-8d55-42ac-89a9-2b6ed11c0a95 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.154680 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b7cc22b5-cc38-484a-8404-edbd1a8a3bc3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:37.155266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-37b2d710-8d55-42ac-89a9-2b6ed11c0a95 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.166739 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7cc22b5-cc38-484a-8404-edbd1a8a3bc3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.167623 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7cc22b5-cc38-484a-8404-edbd1a8a3bc3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.168261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7cc22b5-cc38-484a-8404-edbd1a8a3bc3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.169247 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7cc22b5-cc38-484a-8404-edbd1a8a3bc3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.169883 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7cc22b5-cc38-484a-8404-edbd1a8a3bc3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.170480 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7cc22b5-cc38-484a-8404-edbd1a8a3bc3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.366190 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b7cc22b5-cc38-484a-8404-edbd1a8a3bc3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:37.375553 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b7cc22b5-cc38-484a-8404-edbd1a8a3bc3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1313 microversion: 2.1 time: 0.226279 Aug 24 16:49:37.376282 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-37b2d710-8d55-42ac-89a9-2b6ed11c0a95 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:37.376437 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 133/260] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:37 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:37.387719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-37b2d710-8d55-42ac-89a9-2b6ed11c0a95 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.247206 Aug 24 16:49:37.388455 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 128/261] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:37 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:37.925767 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0ab51f6c-5dd1-4402-83af-8dc1328689b0 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:37.926382 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0ab51f6c-5dd1-4402-83af-8dc1328689b0 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:37.933300 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ab51f6c-5dd1-4402-83af-8dc1328689b0 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.933778 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ab51f6c-5dd1-4402-83af-8dc1328689b0 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.934206 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ab51f6c-5dd1-4402-83af-8dc1328689b0 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.934892 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ab51f6c-5dd1-4402-83af-8dc1328689b0 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.935337 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ab51f6c-5dd1-4402-83af-8dc1328689b0 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.935761 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ab51f6c-5dd1-4402-83af-8dc1328689b0 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:38.069388 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0ab51f6c-5dd1-4402-83af-8dc1328689b0 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:38.077973 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0ab51f6c-5dd1-4402-83af-8dc1328689b0 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1552 microversion: 2.1 time: 0.156016 Aug 24 16:49:38.078542 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 134/262] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:37 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:38.396449 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-85434c08-803f-4618-94af-cdc53e13a488 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:38.397020 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-85434c08-803f-4618-94af-cdc53e13a488 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:38.404013 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85434c08-803f-4618-94af-cdc53e13a488 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:38.407455 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85434c08-803f-4618-94af-cdc53e13a488 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:38.407455 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85434c08-803f-4618-94af-cdc53e13a488 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:38.407455 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85434c08-803f-4618-94af-cdc53e13a488 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:38.407455 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85434c08-803f-4618-94af-cdc53e13a488 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:38.407913 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85434c08-803f-4618-94af-cdc53e13a488 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:38.416080 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-30370e1f-de8f-4c0c-ab39-7f0bbaa62d25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:38.417287 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-30370e1f-de8f-4c0c-ab39-7f0bbaa62d25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:38.425605 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30370e1f-de8f-4c0c-ab39-7f0bbaa62d25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:38.426669 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30370e1f-de8f-4c0c-ab39-7f0bbaa62d25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:38.427285 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30370e1f-de8f-4c0c-ab39-7f0bbaa62d25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:38.428151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30370e1f-de8f-4c0c-ab39-7f0bbaa62d25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:38.429034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30370e1f-de8f-4c0c-ab39-7f0bbaa62d25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:38.429721 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30370e1f-de8f-4c0c-ab39-7f0bbaa62d25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:38.629388 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-85434c08-803f-4618-94af-cdc53e13a488 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:38.629532 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-30370e1f-de8f-4c0c-ab39-7f0bbaa62d25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:38.629653 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-85434c08-803f-4618-94af-cdc53e13a488 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1313 microversion: 2.1 time: 0.235844 Aug 24 16:49:38.629653 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 129/263] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:38 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:38.632365 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-30370e1f-de8f-4c0c-ab39-7f0bbaa62d25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.222656 Aug 24 16:49:38.632973 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 135/264] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:38 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:39.099034 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-49d51d6a-ff33-4cb6-9d26-9b560e5b1def tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:39.101697 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-49d51d6a-ff33-4cb6-9d26-9b560e5b1def tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:39.106409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-49d51d6a-ff33-4cb6-9d26-9b560e5b1def tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.106896 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-49d51d6a-ff33-4cb6-9d26-9b560e5b1def tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.107336 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-49d51d6a-ff33-4cb6-9d26-9b560e5b1def tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.108034 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-49d51d6a-ff33-4cb6-9d26-9b560e5b1def tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.108552 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-49d51d6a-ff33-4cb6-9d26-9b560e5b1def tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.108979 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-49d51d6a-ff33-4cb6-9d26-9b560e5b1def tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.250133 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-49d51d6a-ff33-4cb6-9d26-9b560e5b1def tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:39.258238 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-49d51d6a-ff33-4cb6-9d26-9b560e5b1def tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1552 microversion: 2.1 time: 0.163016 Aug 24 16:49:39.258803 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 130/265] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:39 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:39.649231 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-edc9994b-0623-47a7-9783-f966b92fae31 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:39.649855 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-edc9994b-0623-47a7-9783-f966b92fae31 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:39.654372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9bf79a07-d984-46e4-a7ef-db1e877d34e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:39.659104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9bf79a07-d984-46e4-a7ef-db1e877d34e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:39.659301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-edc9994b-0623-47a7-9783-f966b92fae31 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.659301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-edc9994b-0623-47a7-9783-f966b92fae31 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.659301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-edc9994b-0623-47a7-9783-f966b92fae31 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.659301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-edc9994b-0623-47a7-9783-f966b92fae31 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.659693 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-edc9994b-0623-47a7-9783-f966b92fae31 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.659794 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-edc9994b-0623-47a7-9783-f966b92fae31 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.663577 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9bf79a07-d984-46e4-a7ef-db1e877d34e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.664061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9bf79a07-d984-46e4-a7ef-db1e877d34e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.664520 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9bf79a07-d984-46e4-a7ef-db1e877d34e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.665212 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9bf79a07-d984-46e4-a7ef-db1e877d34e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.665836 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9bf79a07-d984-46e4-a7ef-db1e877d34e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.666260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9bf79a07-d984-46e4-a7ef-db1e877d34e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.862777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-edc9994b-0623-47a7-9783-f966b92fae31 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:39.873883 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9bf79a07-d984-46e4-a7ef-db1e877d34e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:39.881521 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9bf79a07-d984-46e4-a7ef-db1e877d34e0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.231547 Aug 24 16:49:39.882104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 131/266] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:39 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:39.882506 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-edc9994b-0623-47a7-9783-f966b92fae31 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1313 microversion: 2.1 time: 0.232199 Aug 24 16:49:39.883111 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 136/267] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:39 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:40.280007 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b0334639-56fa-4772-a1a5-56f690a34f07 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:40.280891 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b0334639-56fa-4772-a1a5-56f690a34f07 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:40.287724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b0334639-56fa-4772-a1a5-56f690a34f07 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:40.290024 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b0334639-56fa-4772-a1a5-56f690a34f07 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:40.290024 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b0334639-56fa-4772-a1a5-56f690a34f07 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:40.290024 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b0334639-56fa-4772-a1a5-56f690a34f07 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:40.290584 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b0334639-56fa-4772-a1a5-56f690a34f07 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:40.291023 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b0334639-56fa-4772-a1a5-56f690a34f07 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:40.419901 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b0334639-56fa-4772-a1a5-56f690a34f07 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:40.428218 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b0334639-56fa-4772-a1a5-56f690a34f07 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1552 microversion: 2.1 time: 0.152949 Aug 24 16:49:40.428991 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 132/268] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:40 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:40.903815 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b948b4f0-00c8-41ae-85c8-87e44552b7e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:40.903815 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b948b4f0-00c8-41ae-85c8-87e44552b7e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:40.910012 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-aa694cd6-72e7-46c0-9c22-272d3379df01 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:40.910491 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b948b4f0-00c8-41ae-85c8-87e44552b7e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:40.911241 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b948b4f0-00c8-41ae-85c8-87e44552b7e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:40.911241 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b948b4f0-00c8-41ae-85c8-87e44552b7e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:40.911431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-aa694cd6-72e7-46c0-9c22-272d3379df01 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:40.911941 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b948b4f0-00c8-41ae-85c8-87e44552b7e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:40.912390 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b948b4f0-00c8-41ae-85c8-87e44552b7e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:40.912843 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b948b4f0-00c8-41ae-85c8-87e44552b7e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:40.918957 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aa694cd6-72e7-46c0-9c22-272d3379df01 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:40.919479 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aa694cd6-72e7-46c0-9c22-272d3379df01 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:40.919975 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aa694cd6-72e7-46c0-9c22-272d3379df01 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:40.920839 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aa694cd6-72e7-46c0-9c22-272d3379df01 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:40.921356 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aa694cd6-72e7-46c0-9c22-272d3379df01 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:40.921839 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aa694cd6-72e7-46c0-9c22-272d3379df01 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:40.941972 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:41.121516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b948b4f0-00c8-41ae-85c8-87e44552b7e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:41.132093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b948b4f0-00c8-41ae-85c8-87e44552b7e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1313 microversion: 2.1 time: 0.232681 Aug 24 16:49:41.133570 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 137/269] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:40 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:41.136032 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-aa694cd6-72e7-46c0-9c22-272d3379df01 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:41.144867 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-aa694cd6-72e7-46c0-9c22-272d3379df01 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.238776 Aug 24 16:49:41.146260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 133/270] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:40 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:41.456669 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-61bc6517-1fe8-4690-92e9-1906d642ea7b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:41.457812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-61bc6517-1fe8-4690-92e9-1906d642ea7b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:41.466644 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61bc6517-1fe8-4690-92e9-1906d642ea7b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:41.467315 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61bc6517-1fe8-4690-92e9-1906d642ea7b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:41.467953 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61bc6517-1fe8-4690-92e9-1906d642ea7b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:41.468916 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61bc6517-1fe8-4690-92e9-1906d642ea7b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:41.469889 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61bc6517-1fe8-4690-92e9-1906d642ea7b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:41.470862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61bc6517-1fe8-4690-92e9-1906d642ea7b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:41.622225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-61bc6517-1fe8-4690-92e9-1906d642ea7b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:41.633715 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-61bc6517-1fe8-4690-92e9-1906d642ea7b tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1552 microversion: 2.1 time: 0.186391 Aug 24 16:49:41.634638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 138/271] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:41 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1552 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:42.153016 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-30894c07-e2b2-4d20-8d16-c142e5baa654 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:42.154843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-30894c07-e2b2-4d20-8d16-c142e5baa654 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:42.160279 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-30894c07-e2b2-4d20-8d16-c142e5baa654 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.160872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-30894c07-e2b2-4d20-8d16-c142e5baa654 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.161368 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-30894c07-e2b2-4d20-8d16-c142e5baa654 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.162136 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-30894c07-e2b2-4d20-8d16-c142e5baa654 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.162586 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-30894c07-e2b2-4d20-8d16-c142e5baa654 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.163002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-30894c07-e2b2-4d20-8d16-c142e5baa654 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.167385 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-011efae9-1d24-4680-b142-c45e7796230b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:42.168114 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-011efae9-1d24-4680-b142-c45e7796230b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:42.174368 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-011efae9-1d24-4680-b142-c45e7796230b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.175106 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-011efae9-1d24-4680-b142-c45e7796230b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.175604 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-011efae9-1d24-4680-b142-c45e7796230b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.176689 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-011efae9-1d24-4680-b142-c45e7796230b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.177139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-011efae9-1d24-4680-b142-c45e7796230b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.177837 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-011efae9-1d24-4680-b142-c45e7796230b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.393604 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-011efae9-1d24-4680-b142-c45e7796230b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:42.402443 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-30894c07-e2b2-4d20-8d16-c142e5baa654 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:42.406745 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-011efae9-1d24-4680-b142-c45e7796230b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.243671 Aug 24 16:49:42.412149 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 139/272] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:42 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:42.412417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-30894c07-e2b2-4d20-8d16-c142e5baa654 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1313 microversion: 2.1 time: 0.263252 Aug 24 16:49:42.413113 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 134/273] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:42 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:42.655516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8a48dda8-49bc-4344-8f8c-d39ce078d6e2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:42.655516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8a48dda8-49bc-4344-8f8c-d39ce078d6e2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:42.665381 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a48dda8-49bc-4344-8f8c-d39ce078d6e2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.665885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a48dda8-49bc-4344-8f8c-d39ce078d6e2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.666350 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a48dda8-49bc-4344-8f8c-d39ce078d6e2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.673474 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a48dda8-49bc-4344-8f8c-d39ce078d6e2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:42.674000 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a48dda8-49bc-4344-8f8c-d39ce078d6e2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:42.674467 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a48dda8-49bc-4344-8f8c-d39ce078d6e2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:42.820539 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8a48dda8-49bc-4344-8f8c-d39ce078d6e2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:42.829950 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8a48dda8-49bc-4344-8f8c-d39ce078d6e2 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1552 microversion: 2.1 time: 0.178921 Aug 24 16:49:42.830852 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 140/274] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:42 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1552 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:43.084456 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-ceb38474-ce5e-4c75-90ee-e9a05eefee4f req-0d6dce25-505a-48e4-8749-02d8889e9b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568dd29c-4de9-49b4-84f1-44183e65c82d", "name": "network-vif-deleted", "tag": "5cff7808-c87f-4402-a7eb-99555211c7b8"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:43.104837 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-ceb38474-ce5e-4c75-90ee-e9a05eefee4f req-0d6dce25-505a-48e4-8749-02d8889e9b61 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.106836 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-ceb38474-ce5e-4c75-90ee-e9a05eefee4f req-0d6dce25-505a-48e4-8749-02d8889e9b61 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.106836 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-ceb38474-ce5e-4c75-90ee-e9a05eefee4f req-0d6dce25-505a-48e4-8749-02d8889e9b61 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:43.109394 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-4f832902-f7b0-41e0-83d3-4429582cd852 req-faefcf96-ae4f-4144-a280-632dc82fffd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83281073-e14a-4f29-a571-42e2956de57a", "name": "network-vif-plugged", "status": "completed", "tag": "d95e5213-a1b0-476a-b4ad-73a209306cef"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:43.118291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-ceb38474-ce5e-4c75-90ee-e9a05eefee4f req-0d6dce25-505a-48e4-8749-02d8889e9b61 service nova] Creating event network-vif-deleted:5cff7808-c87f-4402-a7eb-99555211c7b8 for instance 568dd29c-4de9-49b4-84f1-44183e65c82d on hv-cinder-85220 Aug 24 16:49:43.122346 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-4f832902-f7b0-41e0-83d3-4429582cd852 req-faefcf96-ae4f-4144-a280-632dc82fffd8 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.123196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-4f832902-f7b0-41e0-83d3-4429582cd852 req-faefcf96-ae4f-4144-a280-632dc82fffd8 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.123654 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-4f832902-f7b0-41e0-83d3-4429582cd852 req-faefcf96-ae4f-4144-a280-632dc82fffd8 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:43.133423 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-ceb38474-ce5e-4c75-90ee-e9a05eefee4f req-0d6dce25-505a-48e4-8749-02d8889e9b61 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054539 Aug 24 16:49:43.134106 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 135/275] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:43.139821 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-4f832902-f7b0-41e0-83d3-4429582cd852 req-faefcf96-ae4f-4144-a280-632dc82fffd8 service nova] Creating event network-vif-plugged:d95e5213-a1b0-476a-b4ad-73a209306cef for instance 83281073-e14a-4f29-a571-42e2956de57a on hv-cinder-85220 Aug 24 16:49:43.145227 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-4f832902-f7b0-41e0-83d3-4429582cd852 req-faefcf96-ae4f-4144-a280-632dc82fffd8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042998 Aug 24 16:49:43.146673 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 141/276] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 24 16:49:43.431728 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d3819947-343c-4e6a-968b-af8a6599525f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:43.432612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d3819947-343c-4e6a-968b-af8a6599525f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:43.433651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2f43caef-01b0-42d0-9ed9-930bd9b679ee tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:43.434496 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2f43caef-01b0-42d0-9ed9-930bd9b679ee tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:43.439110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d3819947-343c-4e6a-968b-af8a6599525f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.443920 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d3819947-343c-4e6a-968b-af8a6599525f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.443920 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d3819947-343c-4e6a-968b-af8a6599525f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:43.443920 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d3819947-343c-4e6a-968b-af8a6599525f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.443920 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d3819947-343c-4e6a-968b-af8a6599525f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.444288 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f43caef-01b0-42d0-9ed9-930bd9b679ee tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.444385 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d3819947-343c-4e6a-968b-af8a6599525f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:43.444505 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f43caef-01b0-42d0-9ed9-930bd9b679ee tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.444505 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f43caef-01b0-42d0-9ed9-930bd9b679ee tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:43.444505 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f43caef-01b0-42d0-9ed9-930bd9b679ee tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.444505 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f43caef-01b0-42d0-9ed9-930bd9b679ee tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.444848 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f43caef-01b0-42d0-9ed9-930bd9b679ee tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:43.650018 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d3819947-343c-4e6a-968b-af8a6599525f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:43.654504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2f43caef-01b0-42d0-9ed9-930bd9b679ee tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:43.658828 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d3819947-343c-4e6a-968b-af8a6599525f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.231359 Aug 24 16:49:43.659594 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 136/277] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:43 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:43.662351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2f43caef-01b0-42d0-9ed9-930bd9b679ee tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1313 microversion: 2.1 time: 0.232738 Aug 24 16:49:43.662892 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 142/278] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:43 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:43.851985 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f866b2aa-7cfb-4c83-9a3d-0174f133310a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:43.852655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f866b2aa-7cfb-4c83-9a3d-0174f133310a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:43.858512 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f866b2aa-7cfb-4c83-9a3d-0174f133310a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.858987 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f866b2aa-7cfb-4c83-9a3d-0174f133310a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.859416 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f866b2aa-7cfb-4c83-9a3d-0174f133310a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:43.860096 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f866b2aa-7cfb-4c83-9a3d-0174f133310a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:43.860573 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f866b2aa-7cfb-4c83-9a3d-0174f133310a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:43.860996 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f866b2aa-7cfb-4c83-9a3d-0174f133310a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:43.925096 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f866b2aa-7cfb-4c83-9a3d-0174f133310a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:43.933386 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f866b2aa-7cfb-4c83-9a3d-0174f133310a tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1345 microversion: 2.1 time: 0.085255 Aug 24 16:49:43.933954 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 137/279] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:43 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:44.679010 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0115bf56-63c0-4777-a590-a79efd2809bb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:44.683284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0115bf56-63c0-4777-a590-a79efd2809bb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:44.687173 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f655e61a-2b46-4536-80aa-3d4f3d4e46e7 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:44.687860 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f655e61a-2b46-4536-80aa-3d4f3d4e46e7 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:44.689806 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0115bf56-63c0-4777-a590-a79efd2809bb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.690416 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0115bf56-63c0-4777-a590-a79efd2809bb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.690852 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0115bf56-63c0-4777-a590-a79efd2809bb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.691554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0115bf56-63c0-4777-a590-a79efd2809bb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.692062 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0115bf56-63c0-4777-a590-a79efd2809bb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.692518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0115bf56-63c0-4777-a590-a79efd2809bb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.694672 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f655e61a-2b46-4536-80aa-3d4f3d4e46e7 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.695158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f655e61a-2b46-4536-80aa-3d4f3d4e46e7 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.695622 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f655e61a-2b46-4536-80aa-3d4f3d4e46e7 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.696311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f655e61a-2b46-4536-80aa-3d4f3d4e46e7 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.696793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f655e61a-2b46-4536-80aa-3d4f3d4e46e7 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.697212 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f655e61a-2b46-4536-80aa-3d4f3d4e46e7 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.841470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f655e61a-2b46-4536-80aa-3d4f3d4e46e7 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:44.849597 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f655e61a-2b46-4536-80aa-3d4f3d4e46e7 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1313 microversion: 2.1 time: 0.166385 Aug 24 16:49:44.850263 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 138/280] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:44 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:44.953835 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:44.954598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:44.960780 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.961275 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.961713 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.962409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.962893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.963835 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.977426 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0115bf56-63c0-4777-a590-a79efd2809bb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:44.985856 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0115bf56-63c0-4777-a590-a79efd2809bb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.310582 Aug 24 16:49:44.986478 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 143/281] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:44 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:44.998199 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:44.998684 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:44.999122 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:44.999581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lazy-loading 'fault' on Instance uuid 568dd29c-4de9-49b4-84f1-44183e65c82d {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:45.046828 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:45.055066 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-11d2739b-6868-4d46-bdf2-2ffc29f079b4 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1350 microversion: 2.1 time: 0.105636 Aug 24 16:49:45.055637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 139/282] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:44 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:45.873048 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fe7e1bdb-f38d-48b2-a839-98ff01c3fd91 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:45.874262 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fe7e1bdb-f38d-48b2-a839-98ff01c3fd91 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:45.879685 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe7e1bdb-f38d-48b2-a839-98ff01c3fd91 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:45.880265 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe7e1bdb-f38d-48b2-a839-98ff01c3fd91 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:45.880745 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe7e1bdb-f38d-48b2-a839-98ff01c3fd91 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:45.881435 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe7e1bdb-f38d-48b2-a839-98ff01c3fd91 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:45.881887 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe7e1bdb-f38d-48b2-a839-98ff01c3fd91 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:45.882308 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe7e1bdb-f38d-48b2-a839-98ff01c3fd91 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:46.006829 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-638d9e35-2a8e-41d5-a0a4-cc23a1c0f488 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:46.007445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-638d9e35-2a8e-41d5-a0a4-cc23a1c0f488 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:46.013674 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-638d9e35-2a8e-41d5-a0a4-cc23a1c0f488 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:46.014163 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-638d9e35-2a8e-41d5-a0a4-cc23a1c0f488 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:46.014606 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-638d9e35-2a8e-41d5-a0a4-cc23a1c0f488 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:46.015302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-638d9e35-2a8e-41d5-a0a4-cc23a1c0f488 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:46.015768 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-638d9e35-2a8e-41d5-a0a4-cc23a1c0f488 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:46.016192 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-638d9e35-2a8e-41d5-a0a4-cc23a1c0f488 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:46.020449 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fe7e1bdb-f38d-48b2-a839-98ff01c3fd91 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:46.023279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:46.029928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fe7e1bdb-f38d-48b2-a839-98ff01c3fd91 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1498 microversion: 2.1 time: 0.161569 Aug 24 16:49:46.031037 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 144/283] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:45 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:46.075921 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:46.076655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:46.082971 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:46.083716 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:46.084442 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:46.097082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:46.097082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:46.097082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:46.124722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:46.125463 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:46.125965 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:46.126615 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lazy-loading 'fault' on Instance uuid 568dd29c-4de9-49b4-84f1-44183e65c82d {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:46.204820 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2257adc34324452a325bb7786d02515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a3a82d90e4811a3037a8cda927913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:46.217060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bc324b94-134c-44c8-a600-9ad89bf93066 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 200 len: 1350 microversion: 2.1 time: 0.145370 Aug 24 16:49:46.224030 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-638d9e35-2a8e-41d5-a0a4-cc23a1c0f488 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:46.230625 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 145/284] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:46 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 1350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:46.233161 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-638d9e35-2a8e-41d5-a0a4-cc23a1c0f488 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.230105 Aug 24 16:49:46.241382 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 140/285] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:46 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:47.236488 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5aab0dd2-8f1d-433b-9fb1-88896cac0a3d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:47.237141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5aab0dd2-8f1d-433b-9fb1-88896cac0a3d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:47.237585 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ab96f0e2-b365-4062-a760-3c9a930b71f5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:47.238204 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ab96f0e2-b365-4062-a760-3c9a930b71f5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:47.243288 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5aab0dd2-8f1d-433b-9fb1-88896cac0a3d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.244037 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5aab0dd2-8f1d-433b-9fb1-88896cac0a3d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.244504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5aab0dd2-8f1d-433b-9fb1-88896cac0a3d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.245189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5aab0dd2-8f1d-433b-9fb1-88896cac0a3d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.245290 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab96f0e2-b365-4062-a760-3c9a930b71f5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.245640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5aab0dd2-8f1d-433b-9fb1-88896cac0a3d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.245751 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab96f0e2-b365-4062-a760-3c9a930b71f5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.246072 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5aab0dd2-8f1d-433b-9fb1-88896cac0a3d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.246179 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab96f0e2-b365-4062-a760-3c9a930b71f5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.246975 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab96f0e2-b365-4062-a760-3c9a930b71f5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.247430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab96f0e2-b365-4062-a760-3c9a930b71f5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.247855 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab96f0e2-b365-4062-a760-3c9a930b71f5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.261767 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-ab96f0e2-b365-4062-a760-3c9a930b71f5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] HTTP exception thrown: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ab96f0e2-b365-4062-a760-3c9a930b71f5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Request method failure captured: Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d HTTP/1.1 Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZFN2NkGU5xebSp5wsucE6KHPdk9l0pmLRUhstpuD_8WYIVoi5kQISgYuDLj3exoxAJscxyCKPqNe3BSoyEU5L7gIHLHRWAyHh__7f5kD2KypIPF1kmmmejrvVUfCctE4fpMBGqE3aaeMt0SdjA3eob1qnAd9oPNaNH2O2eg-Anjs8 Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 3b5a3a82d90e4811a3037a8cda927913 Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-DeleteServersTestJSON-125712016 Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:49:47.266440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:49:47.267879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:49:47.267879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-DeleteServersTestJSON-125712016 Aug 24 16:49:47.267879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 3b5a3a82d90e4811a3037a8cda927913 Aug 24 16:49:47.267879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-DeleteServersTestJSON-125712016 Aug 24 16:49:47.267879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-DeleteServersTestJSON-125712016-project Aug 24 16:49:47.267879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:49:47.267879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:49:47.267879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: e2257adc34324452a325bb7786d02515 Aug 24 16:49:47.267879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-DeleteServersTestJSON-125712016-project Aug 24 16:49:47.267879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:49:47.267879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:47.267879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '568dd29c-4de9-49b4-84f1-44183e65c82d'} Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:47.271998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:47.273408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:49:47.274972 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ab96f0e2-b365-4062-a760-3c9a930b71f5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Returning 404 to user: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:47.274972 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ab96f0e2-b365-4062-a760-3c9a930b71f5 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 404 len: 111 microversion: 2.1 time: 0.034357 Aug 24 16:49:47.274972 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 141/286] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:47 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:49:47.274972 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-504b6ecf-47fc-4292-8232-1d36974233ae tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:47.274972 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-504b6ecf-47fc-4292-8232-1d36974233ae tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:47.275305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5aab0dd2-8f1d-433b-9fb1-88896cac0a3d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:49:47.283051 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-504b6ecf-47fc-4292-8232-1d36974233ae tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.283051 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-504b6ecf-47fc-4292-8232-1d36974233ae tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.283051 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-504b6ecf-47fc-4292-8232-1d36974233ae tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.283537 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-504b6ecf-47fc-4292-8232-1d36974233ae tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.283722 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-504b6ecf-47fc-4292-8232-1d36974233ae tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.284197 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-504b6ecf-47fc-4292-8232-1d36974233ae tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.440527 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-504b6ecf-47fc-4292-8232-1d36974233ae tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:47.449469 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-504b6ecf-47fc-4292-8232-1d36974233ae tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.179628 Aug 24 16:49:47.450060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 142/287] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:47 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:47.454942 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e4c8c77b-9bf8-4640-bdc9-f3be57b45b92 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:47.457224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e4c8c77b-9bf8-4640-bdc9-f3be57b45b92 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:47.463160 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e4c8c77b-9bf8-4640-bdc9-f3be57b45b92 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.464216 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e4c8c77b-9bf8-4640-bdc9-f3be57b45b92 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.464687 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e4c8c77b-9bf8-4640-bdc9-f3be57b45b92 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.465368 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e4c8c77b-9bf8-4640-bdc9-f3be57b45b92 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.465822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e4c8c77b-9bf8-4640-bdc9-f3be57b45b92 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.466241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e4c8c77b-9bf8-4640-bdc9-f3be57b45b92 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.478796 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-e4c8c77b-9bf8-4640-bdc9-f3be57b45b92 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] HTTP exception thrown: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e4c8c77b-9bf8-4640-bdc9-f3be57b45b92 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Request method failure captured: Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d/os-volume_attachments HTTP/1.1 Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZFN2NkGU5xebSp5wsucE6KHPdk9l0pmLRUhstpuD_8WYIVoi5kQISgYuDLj3exoxAJscxyCKPqNe3BSoyEU5L7gIHLHRWAyHh__7f5kD2KypIPF1kmmmejrvVUfCctE4fpMBGqE3aaeMt0SdjA3eob1qnAd9oPNaNH2O2eg-Anjs8 Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 3b5a3a82d90e4811a3037a8cda927913 Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-DeleteServersTestJSON-125712016 Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:49:47.480655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:49:47.482057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:49:47.482057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-DeleteServersTestJSON-125712016 Aug 24 16:49:47.482057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 3b5a3a82d90e4811a3037a8cda927913 Aug 24 16:49:47.482057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-DeleteServersTestJSON-125712016 Aug 24 16:49:47.482057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-DeleteServersTestJSON-125712016-project Aug 24 16:49:47.482057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:49:47.482057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:49:47.482057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: e2257adc34324452a325bb7786d02515 Aug 24 16:49:47.482057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-DeleteServersTestJSON-125712016-project Aug 24 16:49:47.482057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:49:47.482057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:47.482057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'server_id': '568dd29c-4de9-49b4-84f1-44183e65c82d'} Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:47.482788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:47.483843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:49:47.485117 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e4c8c77b-9bf8-4640-bdc9-f3be57b45b92 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Returning 404 to user: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:47.485117 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e4c8c77b-9bf8-4640-bdc9-f3be57b45b92 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030985 Aug 24 16:49:47.485117 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 143/288] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:49:47 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:49:47.564590 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5aab0dd2-8f1d-433b-9fb1-88896cac0a3d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "DELETE /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 204 len: 0 microversion: 2.1 time: 0.330403 Aug 24 16:49:47.564590 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 146/289] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:49:47 2022] DELETE /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:47.572101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fe8877eb-6af5-4fed-9d90-6a81776793ab tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:47.573285 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fe8877eb-6af5-4fed-9d90-6a81776793ab tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:47.579142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe8877eb-6af5-4fed-9d90-6a81776793ab tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.579624 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe8877eb-6af5-4fed-9d90-6a81776793ab tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.580057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe8877eb-6af5-4fed-9d90-6a81776793ab tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.582568 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe8877eb-6af5-4fed-9d90-6a81776793ab tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:47.583061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe8877eb-6af5-4fed-9d90-6a81776793ab tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:47.583494 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe8877eb-6af5-4fed-9d90-6a81776793ab tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:47.715776 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fe8877eb-6af5-4fed-9d90-6a81776793ab tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:47.723483 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fe8877eb-6af5-4fed-9d90-6a81776793ab tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1504 microversion: 2.1 time: 0.155186 Aug 24 16:49:47.724037 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 144/290] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:47 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:48.472226 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-98b77f2a-3aa1-418f-87ca-8e492af6ac5b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:48.472969 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-98b77f2a-3aa1-418f-87ca-8e492af6ac5b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:48.479211 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-98b77f2a-3aa1-418f-87ca-8e492af6ac5b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.479683 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-98b77f2a-3aa1-418f-87ca-8e492af6ac5b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.480156 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-98b77f2a-3aa1-418f-87ca-8e492af6ac5b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.480869 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-98b77f2a-3aa1-418f-87ca-8e492af6ac5b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.481319 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-98b77f2a-3aa1-418f-87ca-8e492af6ac5b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.481736 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-98b77f2a-3aa1-418f-87ca-8e492af6ac5b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.613455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-98b77f2a-3aa1-418f-87ca-8e492af6ac5b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:48.622097 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-98b77f2a-3aa1-418f-87ca-8e492af6ac5b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.154250 Aug 24 16:49:48.622652 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 147/291] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:48 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:48.745183 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6ada28af-2958-4a5d-9494-9f131ed2490d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:48.745884 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6ada28af-2958-4a5d-9494-9f131ed2490d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:48.752295 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6ada28af-2958-4a5d-9494-9f131ed2490d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.756111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6ada28af-2958-4a5d-9494-9f131ed2490d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.756111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6ada28af-2958-4a5d-9494-9f131ed2490d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.756111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6ada28af-2958-4a5d-9494-9f131ed2490d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.756111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6ada28af-2958-4a5d-9494-9f131ed2490d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.756492 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6ada28af-2958-4a5d-9494-9f131ed2490d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.819324 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9f5f8f1e-44d9-4aaa-850d-39b36a3b1099 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:48.819904 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9f5f8f1e-44d9-4aaa-850d-39b36a3b1099 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:48.827395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f1e-44d9-4aaa-850d-39b36a3b1099 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.827886 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f1e-44d9-4aaa-850d-39b36a3b1099 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.828322 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f1e-44d9-4aaa-850d-39b36a3b1099 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.829055 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f1e-44d9-4aaa-850d-39b36a3b1099 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.829510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f1e-44d9-4aaa-850d-39b36a3b1099 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.829934 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f1e-44d9-4aaa-850d-39b36a3b1099 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.844351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-9f5f8f1e-44d9-4aaa-850d-39b36a3b1099 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] HTTP exception thrown: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9f5f8f1e-44d9-4aaa-850d-39b36a3b1099 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Request method failure captured: Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: DELETE /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d HTTP/1.1 Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZFN2NkGU5xebSp5wsucE6KHPdk9l0pmLRUhstpuD_8WYIVoi5kQISgYuDLj3exoxAJscxyCKPqNe3BSoyEU5L7gIHLHRWAyHh__7f5kD2KypIPF1kmmmejrvVUfCctE4fpMBGqE3aaeMt0SdjA3eob1qnAd9oPNaNH2O2eg-Anjs8 Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 3b5a3a82d90e4811a3037a8cda927913 Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-DeleteServersTestJSON-125712016 Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:49:48.849606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:49:48.851011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:49:48.851011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-DeleteServersTestJSON-125712016 Aug 24 16:49:48.851011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 3b5a3a82d90e4811a3037a8cda927913 Aug 24 16:49:48.851011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-DeleteServersTestJSON-125712016 Aug 24 16:49:48.851011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-DeleteServersTestJSON-125712016-project Aug 24 16:49:48.851011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:49:48.851011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:49:48.851011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: e2257adc34324452a325bb7786d02515 Aug 24 16:49:48.851011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-DeleteServersTestJSON-125712016-project Aug 24 16:49:48.851011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:49:48.851011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:48.851011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '568dd29c-4de9-49b4-84f1-44183e65c82d'} Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:48.851844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:48.853176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:48.855064 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9f5f8f1e-44d9-4aaa-850d-39b36a3b1099 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Returning 404 to user: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:48.855064 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9f5f8f1e-44d9-4aaa-850d-39b36a3b1099 tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "DELETE /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 404 len: 111 microversion: 2.1 time: 0.035578 Aug 24 16:49:48.855064 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 148/292] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:49:48 2022] DELETE /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:49:48.859932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-99b7e9ec-32de-435a-bebe-22f39a9e2eba tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:48.860639 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-99b7e9ec-32de-435a-bebe-22f39a9e2eba tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] [instance: 568dd29c-4de9-49b4-84f1-44183e65c82d] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:48.870309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99b7e9ec-32de-435a-bebe-22f39a9e2eba tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.870309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99b7e9ec-32de-435a-bebe-22f39a9e2eba tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.870309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99b7e9ec-32de-435a-bebe-22f39a9e2eba tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.870309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99b7e9ec-32de-435a-bebe-22f39a9e2eba tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:48.870670 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99b7e9ec-32de-435a-bebe-22f39a9e2eba tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:48.870670 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99b7e9ec-32de-435a-bebe-22f39a9e2eba tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:48.886834 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-99b7e9ec-32de-435a-bebe-22f39a9e2eba tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] HTTP exception thrown: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:48.887912 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6ada28af-2958-4a5d-9494-9f131ed2490d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-99b7e9ec-32de-435a-bebe-22f39a9e2eba tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Request method failure captured: Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d HTTP/1.1 Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZFN2NkGU5xebSp5wsucE6KHPdk9l0pmLRUhstpuD_8WYIVoi5kQISgYuDLj3exoxAJscxyCKPqNe3BSoyEU5L7gIHLHRWAyHh__7f5kD2KypIPF1kmmmejrvVUfCctE4fpMBGqE3aaeMt0SdjA3eob1qnAd9oPNaNH2O2eg-Anjs8 Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 3b5a3a82d90e4811a3037a8cda927913 Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-DeleteServersTestJSON-125712016 Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:49:48.888354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:49:48.889584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b5a3a82d90e4811a3037a8cda927913"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:49:48.889584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-DeleteServersTestJSON-125712016 Aug 24 16:49:48.889584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 3b5a3a82d90e4811a3037a8cda927913 Aug 24 16:49:48.889584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-DeleteServersTestJSON-125712016 Aug 24 16:49:48.889584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-DeleteServersTestJSON-125712016-project Aug 24 16:49:48.889584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:49:48.889584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:49:48.889584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: e2257adc34324452a325bb7786d02515 Aug 24 16:49:48.889584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-DeleteServersTestJSON-125712016-project Aug 24 16:49:48.889584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:49:48.889584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:48.889584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '568dd29c-4de9-49b4-84f1-44183e65c82d'} Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:48.890411 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. Aug 24 16:49:48.891490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:48.892493 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-99b7e9ec-32de-435a-bebe-22f39a9e2eba tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] Returning 404 to user: Instance 568dd29c-4de9-49b4-84f1-44183e65c82d could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:48.892493 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-99b7e9ec-32de-435a-bebe-22f39a9e2eba tempest-DeleteServersTestJSON-125712016 tempest-DeleteServersTestJSON-125712016-project] 10.222.0.70 "GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d" status: 404 len: 111 microversion: 2.1 time: 0.033533 Aug 24 16:49:48.892493 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 149/293] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:48 2022] GET /compute/v2.1/servers/568dd29c-4de9-49b4-84f1-44183e65c82d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:49:48.899420 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6ada28af-2958-4a5d-9494-9f131ed2490d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1504 microversion: 2.1 time: 0.158817 Aug 24 16:49:48.899998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 145/294] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:48 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:49.642980 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-035e78f1-d6d9-4e2f-af99-eb9158a7f091 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:49.643603 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-035e78f1-d6d9-4e2f-af99-eb9158a7f091 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:49.650051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-035e78f1-d6d9-4e2f-af99-eb9158a7f091 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:49.650428 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-035e78f1-d6d9-4e2f-af99-eb9158a7f091 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:49.650863 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-035e78f1-d6d9-4e2f-af99-eb9158a7f091 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:49.651874 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-035e78f1-d6d9-4e2f-af99-eb9158a7f091 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:49.652336 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-035e78f1-d6d9-4e2f-af99-eb9158a7f091 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:49.652946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-035e78f1-d6d9-4e2f-af99-eb9158a7f091 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:49.876188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-035e78f1-d6d9-4e2f-af99-eb9158a7f091 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:49.884365 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-035e78f1-d6d9-4e2f-af99-eb9158a7f091 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.245337 Aug 24 16:49:49.884968 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 150/295] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:49 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:49.920500 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c2ab7fca-81b9-4761-884b-4ba91599abb5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:49.921379 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c2ab7fca-81b9-4761-884b-4ba91599abb5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:49.927983 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c2ab7fca-81b9-4761-884b-4ba91599abb5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:49.928490 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c2ab7fca-81b9-4761-884b-4ba91599abb5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:49.929146 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c2ab7fca-81b9-4761-884b-4ba91599abb5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:49.930062 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c2ab7fca-81b9-4761-884b-4ba91599abb5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:49.930860 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c2ab7fca-81b9-4761-884b-4ba91599abb5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:49.931498 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c2ab7fca-81b9-4761-884b-4ba91599abb5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:50.387703 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c2ab7fca-81b9-4761-884b-4ba91599abb5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:50.398847 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c2ab7fca-81b9-4761-884b-4ba91599abb5 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1504 microversion: 2.1 time: 0.482614 Aug 24 16:49:50.400742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 146/296] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:49 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1504 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:50.906523 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-025f69ae-2798-4e89-a6fe-287604a3d51d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:50.907904 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-025f69ae-2798-4e89-a6fe-287604a3d51d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:50.914302 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-025f69ae-2798-4e89-a6fe-287604a3d51d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:50.915089 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-025f69ae-2798-4e89-a6fe-287604a3d51d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:50.915892 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-025f69ae-2798-4e89-a6fe-287604a3d51d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:50.916864 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-025f69ae-2798-4e89-a6fe-287604a3d51d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:50.917555 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-025f69ae-2798-4e89-a6fe-287604a3d51d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:50.918240 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-025f69ae-2798-4e89-a6fe-287604a3d51d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:50.926745 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-eeb16aed-30f4-4d30-b42d-3de5ce197d8a req-a7b283d4-fa77-45f1-b653-e2886005f73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83281073-e14a-4f29-a571-42e2956de57a", "name": "network-vif-deleted", "tag": "d95e5213-a1b0-476a-b4ad-73a209306cef"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:50.951172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-eeb16aed-30f4-4d30-b42d-3de5ce197d8a req-a7b283d4-fa77-45f1-b653-e2886005f73f service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:50.951736 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-eeb16aed-30f4-4d30-b42d-3de5ce197d8a req-a7b283d4-fa77-45f1-b653-e2886005f73f service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:50.952208 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-eeb16aed-30f4-4d30-b42d-3de5ce197d8a req-a7b283d4-fa77-45f1-b653-e2886005f73f service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:51.122008 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-025f69ae-2798-4e89-a6fe-287604a3d51d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:51.126011 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-eeb16aed-30f4-4d30-b42d-3de5ce197d8a req-a7b283d4-fa77-45f1-b653-e2886005f73f service nova] Creating event network-vif-deleted:d95e5213-a1b0-476a-b4ad-73a209306cef for instance 83281073-e14a-4f29-a571-42e2956de57a on hv-cinder-85220 Aug 24 16:49:51.130783 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-025f69ae-2798-4e89-a6fe-287604a3d51d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.228241 Aug 24 16:49:51.131651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 151/297] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:50 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:51.133770 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-eeb16aed-30f4-4d30-b42d-3de5ce197d8a req-a7b283d4-fa77-45f1-b653-e2886005f73f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213298 Aug 24 16:49:51.134450 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 147/298] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:49:51.423857 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:51.424503 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:51.431067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:51.431546 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:51.433178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:51.434205 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:51.434703 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:51.435147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:51.474350 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:51.475131 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:51.475750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:51.476185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lazy-loading 'fault' on Instance uuid 83281073-e14a-4f29-a571-42e2956de57a {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:49:51.543777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:51.553737 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1a9154e1-e503-4117-9170-20695bc98799 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 200 len: 1303 microversion: 2.1 time: 0.135064 Aug 24 16:49:51.555511 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 152/299] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:51 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 1303 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:52.153274 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b4c15371-f063-4235-8e86-3907970af683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:52.153966 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b4c15371-f063-4235-8e86-3907970af683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:52.161507 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b4c15371-f063-4235-8e86-3907970af683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:52.162412 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b4c15371-f063-4235-8e86-3907970af683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:52.163029 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b4c15371-f063-4235-8e86-3907970af683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:52.163888 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b4c15371-f063-4235-8e86-3907970af683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:52.164335 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b4c15371-f063-4235-8e86-3907970af683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:52.164781 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b4c15371-f063-4235-8e86-3907970af683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:52.321054 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b4c15371-f063-4235-8e86-3907970af683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:52.330870 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b4c15371-f063-4235-8e86-3907970af683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.183482 Aug 24 16:49:52.343043 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 148/300] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:52 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:52.576375 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-939f0cef-a32d-4775-bebd-25544e70922e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:52.582768 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-939f0cef-a32d-4775-bebd-25544e70922e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 83281073-e14a-4f29-a571-42e2956de57a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:52.589165 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-939f0cef-a32d-4775-bebd-25544e70922e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:52.589651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-939f0cef-a32d-4775-bebd-25544e70922e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:52.590081 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-939f0cef-a32d-4775-bebd-25544e70922e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:52.591465 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-939f0cef-a32d-4775-bebd-25544e70922e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:52.591921 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-939f0cef-a32d-4775-bebd-25544e70922e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:52.592339 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-939f0cef-a32d-4775-bebd-25544e70922e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:52.613455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-939f0cef-a32d-4775-bebd-25544e70922e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] HTTP exception thrown: Instance 83281073-e14a-4f29-a571-42e2956de57a could not be found. Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-939f0cef-a32d-4775-bebd-25544e70922e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Request method failure captured: Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a HTTP/1.1 Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlaRHyYaK6_iXwqn-sY7Vd_zjphZaQ5h0lyVHXe097K6JIx1omOUdDiOl3XC8I11wY1rcluCXoKvK7SiMhLNvInWKUktKHUhRwo8zAG5wKHiC0JXd8ks8RhxeUwzAKtx5pSrZ_btWv3w0w_JL-JIux1i-zBim4xOvidDXAc37t_55-o Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: cd5a0fa1909747368101df31693c44e1 Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-VolumesActionsTest-1724408736 Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:49:52.619251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:49:52.621457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd5a0fa1909747368101df31693c44e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd5a0fa1909747368101df31693c44e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd5a0fa1909747368101df31693c44e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd5a0fa1909747368101df31693c44e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:49:52.621457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-VolumesActionsTest-1724408736 Aug 24 16:49:52.621457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: cd5a0fa1909747368101df31693c44e1 Aug 24 16:49:52.621457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-VolumesActionsTest-1724408736 Aug 24 16:49:52.621457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-VolumesActionsTest-1724408736-project Aug 24 16:49:52.621457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:49:52.621457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:49:52.621457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 55975de527254dca90fc4f30bc50e393 Aug 24 16:49:52.621457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-VolumesActionsTest-1724408736-project Aug 24 16:49:52.621457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:49:52.621457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 83281073-e14a-4f29-a571-42e2956de57a could not be found. Aug 24 16:49:52.621457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '83281073-e14a-4f29-a571-42e2956de57a'} Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83281073-e14a-4f29-a571-42e2956de57a could not be found. Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:52.633261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83281073-e14a-4f29-a571-42e2956de57a could not be found. Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83281073-e14a-4f29-a571-42e2956de57a could not be found. Aug 24 16:49:52.634614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:49:52.635834 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-939f0cef-a32d-4775-bebd-25544e70922e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Returning 404 to user: Instance 83281073-e14a-4f29-a571-42e2956de57a could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:52.635834 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-939f0cef-a32d-4775-bebd-25544e70922e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a" status: 404 len: 111 microversion: 2.1 time: 0.046739 Aug 24 16:49:52.635834 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 153/301] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:52 2022] GET /compute/v2.1/servers/83281073-e14a-4f29-a571-42e2956de57a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:49:52.771418 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-516787618", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "networks": [{"uuid": "9d0c8cfb-12b0-4ae8-9a7d-4ccf80bf5709"}]}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:52.830997 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.network.neutron [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] validate_networks() for [('9d0c8cfb-12b0-4ae8-9a7d-4ccf80bf5709', None, None, None, None, None)] {{(pid=127715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:49:53.352009 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1e6afbc4-7c10-4df1-9d80-6a9fb54c201b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:53.352640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1e6afbc4-7c10-4df1-9d80-6a9fb54c201b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:53.359158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e6afbc4-7c10-4df1-9d80-6a9fb54c201b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:53.359633 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e6afbc4-7c10-4df1-9d80-6a9fb54c201b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:53.360108 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e6afbc4-7c10-4df1-9d80-6a9fb54c201b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:53.360974 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e6afbc4-7c10-4df1-9d80-6a9fb54c201b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:53.361422 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e6afbc4-7c10-4df1-9d80-6a9fb54c201b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:53.361836 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e6afbc4-7c10-4df1-9d80-6a9fb54c201b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:53.718545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1e6afbc4-7c10-4df1-9d80-6a9fb54c201b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:53.726236 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1e6afbc4-7c10-4df1-9d80-6a9fb54c201b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.377978 Aug 24 16:49:53.726804 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 154/302] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:53 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:53.736265 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Flavor limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:49:53.736953 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Image limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:49:53.737694 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Flavor pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:49:53.738212 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Image pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:49:53.738691 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:49:53.750075 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:53.750826 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:53.751230 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:53.751912 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:53.752586 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:53.753018 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:53.774914 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Getting quotas for project cd5a0fa1909747368101df31693c44e1. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:49:53.779219 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Getting quotas for user 55975de527254dca90fc4f30bc50e393 and project cd5a0fa1909747368101df31693c44e1. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:49:53.791695 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Going to run 1 instances... {{(pid=127715) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:49:53.794341 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:49:53.980109 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-61529799-b82b-4a83-ba15-cb7a79e2bc9c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.212608 Aug 24 16:49:53.981288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 149/303] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:49:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:49:53.992189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-75827e58-5e9e-4297-96f3-78169d66d3e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:53.993239 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-75827e58-5e9e-4297-96f3-78169d66d3e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:54.078618 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-75827e58-5e9e-4297-96f3-78169d66d3e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:54.088137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-75827e58-5e9e-4297-96f3-78169d66d3e9 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1213 microversion: 2.1 time: 0.099971 Aug 24 16:49:54.089320 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 155/304] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:53 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:54.751486 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9783084c-a8e3-476c-a72e-50108688c683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:54.752089 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9783084c-a8e3-476c-a72e-50108688c683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:54.762105 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9783084c-a8e3-476c-a72e-50108688c683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:54.764615 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9783084c-a8e3-476c-a72e-50108688c683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:54.764615 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9783084c-a8e3-476c-a72e-50108688c683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:54.764935 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9783084c-a8e3-476c-a72e-50108688c683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:54.765582 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9783084c-a8e3-476c-a72e-50108688c683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:54.766326 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9783084c-a8e3-476c-a72e-50108688c683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:54.924042 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9783084c-a8e3-476c-a72e-50108688c683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:54.932076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9783084c-a8e3-476c-a72e-50108688c683 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.184490 Aug 24 16:49:54.936836 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 150/305] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:54 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:55.108580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7c8b3ff1-c935-429b-9adb-598f33c6b31b tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:55.109192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7c8b3ff1-c935-429b-9adb-598f33c6b31b tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:55.115111 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c8b3ff1-c935-429b-9adb-598f33c6b31b tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:55.115597 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c8b3ff1-c935-429b-9adb-598f33c6b31b tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:55.116013 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c8b3ff1-c935-429b-9adb-598f33c6b31b tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:55.116720 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c8b3ff1-c935-429b-9adb-598f33c6b31b tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:55.117165 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c8b3ff1-c935-429b-9adb-598f33c6b31b tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:55.117578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c8b3ff1-c935-429b-9adb-598f33c6b31b tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:55.179510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7c8b3ff1-c935-429b-9adb-598f33c6b31b tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:55.187108 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7c8b3ff1-c935-429b-9adb-598f33c6b31b tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1217 microversion: 2.1 time: 0.082362 Aug 24 16:49:55.187657 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 156/306] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:55 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:55.958859 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c99f2374-2b25-4ddf-a625-116621a17690 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:55.959461 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c99f2374-2b25-4ddf-a625-116621a17690 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:55.966687 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c99f2374-2b25-4ddf-a625-116621a17690 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:55.967178 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c99f2374-2b25-4ddf-a625-116621a17690 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:55.968253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c99f2374-2b25-4ddf-a625-116621a17690 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:55.968427 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c99f2374-2b25-4ddf-a625-116621a17690 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:55.968907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c99f2374-2b25-4ddf-a625-116621a17690 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:55.969334 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c99f2374-2b25-4ddf-a625-116621a17690 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.145016 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c99f2374-2b25-4ddf-a625-116621a17690 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:56.152798 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c99f2374-2b25-4ddf-a625-116621a17690 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.197677 Aug 24 16:49:56.153360 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 151/307] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:55 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:56.207146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a18e89ff-d52e-4e77-890c-0141615ca16e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:56.207812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a18e89ff-d52e-4e77-890c-0141615ca16e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:56.210088 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:56.214833 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a18e89ff-d52e-4e77-890c-0141615ca16e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.215315 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a18e89ff-d52e-4e77-890c-0141615ca16e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.215745 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a18e89ff-d52e-4e77-890c-0141615ca16e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.216456 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a18e89ff-d52e-4e77-890c-0141615ca16e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.216906 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a18e89ff-d52e-4e77-890c-0141615ca16e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.217323 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a18e89ff-d52e-4e77-890c-0141615ca16e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.291240 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a18e89ff-d52e-4e77-890c-0141615ca16e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:56.302069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a18e89ff-d52e-4e77-890c-0141615ca16e tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1273 microversion: 2.1 time: 0.098650 Aug 24 16:49:56.303243 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 157/308] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:56 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:57.179817 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-80193fdf-8366-413c-a4cb-6b2bc379d12f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:57.180627 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-80193fdf-8366-413c-a4cb-6b2bc379d12f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:57.187209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-80193fdf-8366-413c-a4cb-6b2bc379d12f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:57.187721 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-80193fdf-8366-413c-a4cb-6b2bc379d12f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:57.188175 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-80193fdf-8366-413c-a4cb-6b2bc379d12f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:57.189066 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-80193fdf-8366-413c-a4cb-6b2bc379d12f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:57.189525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-80193fdf-8366-413c-a4cb-6b2bc379d12f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:57.189949 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-80193fdf-8366-413c-a4cb-6b2bc379d12f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:57.324568 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d2647dfa-8e23-4a27-8bc7-cfbcc8721bf3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:57.326067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d2647dfa-8e23-4a27-8bc7-cfbcc8721bf3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:57.334246 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-80193fdf-8366-413c-a4cb-6b2bc379d12f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:57.342614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2647dfa-8e23-4a27-8bc7-cfbcc8721bf3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:57.347051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2647dfa-8e23-4a27-8bc7-cfbcc8721bf3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:57.347311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-80193fdf-8366-413c-a4cb-6b2bc379d12f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.174360 Aug 24 16:49:57.347428 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2647dfa-8e23-4a27-8bc7-cfbcc8721bf3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:57.347523 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 152/309] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:57 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:57.347610 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2647dfa-8e23-4a27-8bc7-cfbcc8721bf3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:57.347610 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2647dfa-8e23-4a27-8bc7-cfbcc8721bf3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:57.347610 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2647dfa-8e23-4a27-8bc7-cfbcc8721bf3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:57.497500 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d2647dfa-8e23-4a27-8bc7-cfbcc8721bf3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:57.505327 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d2647dfa-8e23-4a27-8bc7-cfbcc8721bf3 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.185701 Aug 24 16:49:57.505971 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 158/310] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:57 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:58.020332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-3d55d9b4-ccaa-463c-917a-2aabcdf0dd48 req-66e75ac5-5e2b-4c86-ac0d-c74ff594679e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb816b7-df6d-4661-a949-791633431051", "tag": "00850e15-8b1a-4ef1-859a-2df0388a711a"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:58.029872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-3d55d9b4-ccaa-463c-917a-2aabcdf0dd48 req-66e75ac5-5e2b-4c86-ac0d-c74ff594679e service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.030368 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-3d55d9b4-ccaa-463c-917a-2aabcdf0dd48 req-66e75ac5-5e2b-4c86-ac0d-c74ff594679e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.030800 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-3d55d9b4-ccaa-463c-917a-2aabcdf0dd48 req-66e75ac5-5e2b-4c86-ac0d-c74ff594679e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.034621 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:58.041998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-3d55d9b4-ccaa-463c-917a-2aabcdf0dd48 req-66e75ac5-5e2b-4c86-ac0d-c74ff594679e service nova] Creating event network-changed:00850e15-8b1a-4ef1-859a-2df0388a711a for instance 5cb816b7-df6d-4661-a949-791633431051 on hv-cinder-85220 Aug 24 16:49:58.046733 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-3d55d9b4-ccaa-463c-917a-2aabcdf0dd48 req-66e75ac5-5e2b-4c86-ac0d-c74ff594679e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030165 Aug 24 16:49:58.047323 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 153/311] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:58.366231 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7905af85-59d2-4118-a046-c811957ca92a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:58.366842 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7905af85-59d2-4118-a046-c811957ca92a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:58.375139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7905af85-59d2-4118-a046-c811957ca92a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.375506 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7905af85-59d2-4118-a046-c811957ca92a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.375934 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7905af85-59d2-4118-a046-c811957ca92a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.376654 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7905af85-59d2-4118-a046-c811957ca92a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.377105 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7905af85-59d2-4118-a046-c811957ca92a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.377560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7905af85-59d2-4118-a046-c811957ca92a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.528911 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-89f8775c-ab6f-4ef1-8d47-8fe0b6e51b3f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:58.529612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-89f8775c-ab6f-4ef1-8d47-8fe0b6e51b3f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:58.546755 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89f8775c-ab6f-4ef1-8d47-8fe0b6e51b3f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.552863 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89f8775c-ab6f-4ef1-8d47-8fe0b6e51b3f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.552863 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89f8775c-ab6f-4ef1-8d47-8fe0b6e51b3f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.552863 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89f8775c-ab6f-4ef1-8d47-8fe0b6e51b3f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.552863 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89f8775c-ab6f-4ef1-8d47-8fe0b6e51b3f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.553191 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89f8775c-ab6f-4ef1-8d47-8fe0b6e51b3f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.824219 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7905af85-59d2-4118-a046-c811957ca92a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:58.839147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7905af85-59d2-4118-a046-c811957ca92a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.475298 Aug 24 16:49:58.841282 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 159/312] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:58 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:58.880389 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-89f8775c-ab6f-4ef1-8d47-8fe0b6e51b3f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:58.889482 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-89f8775c-ab6f-4ef1-8d47-8fe0b6e51b3f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.365985 Aug 24 16:49:58.890065 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 154/313] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:58 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:59.861069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3576adf1-6f75-402a-bf54-41e83faa8611 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:59.862066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3576adf1-6f75-402a-bf54-41e83faa8611 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:59.867966 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3576adf1-6f75-402a-bf54-41e83faa8611 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:59.868471 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3576adf1-6f75-402a-bf54-41e83faa8611 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:59.868913 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3576adf1-6f75-402a-bf54-41e83faa8611 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:59.870730 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3576adf1-6f75-402a-bf54-41e83faa8611 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:59.870730 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3576adf1-6f75-402a-bf54-41e83faa8611 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:59.871076 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3576adf1-6f75-402a-bf54-41e83faa8611 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:59.911032 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-dba89c7a-6931-439f-9c69-8912dfece32f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:59.911782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-dba89c7a-6931-439f-9c69-8912dfece32f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:59.919034 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dba89c7a-6931-439f-9c69-8912dfece32f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:59.919515 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dba89c7a-6931-439f-9c69-8912dfece32f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:59.919939 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dba89c7a-6931-439f-9c69-8912dfece32f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:59.920928 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dba89c7a-6931-439f-9c69-8912dfece32f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:59.921334 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dba89c7a-6931-439f-9c69-8912dfece32f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:59.921787 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dba89c7a-6931-439f-9c69-8912dfece32f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:00.060851 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3576adf1-6f75-402a-bf54-41e83faa8611 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:00.071726 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3576adf1-6f75-402a-bf54-41e83faa8611 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.214462 Aug 24 16:50:00.072584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 160/314] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:59 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:00.093028 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-dba89c7a-6931-439f-9c69-8912dfece32f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:00.100755 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-dba89c7a-6931-439f-9c69-8912dfece32f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.193491 Aug 24 16:50:00.101296 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 155/315] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:59 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:01.099609 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1f7aaa9f-43a1-4c58-ac64-5a3fae87cdf8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:01.100692 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1f7aaa9f-43a1-4c58-ac64-5a3fae87cdf8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:01.112177 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f7aaa9f-43a1-4c58-ac64-5a3fae87cdf8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:01.112919 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f7aaa9f-43a1-4c58-ac64-5a3fae87cdf8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:01.114472 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f7aaa9f-43a1-4c58-ac64-5a3fae87cdf8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:01.115352 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f7aaa9f-43a1-4c58-ac64-5a3fae87cdf8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:01.115967 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f7aaa9f-43a1-4c58-ac64-5a3fae87cdf8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:01.116630 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f7aaa9f-43a1-4c58-ac64-5a3fae87cdf8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:01.125525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-87ac3a44-8ff8-45e9-aaf4-9da4659e5d30 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:01.127180 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-87ac3a44-8ff8-45e9-aaf4-9da4659e5d30 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:01.152105 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-87ac3a44-8ff8-45e9-aaf4-9da4659e5d30 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:01.152105 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-87ac3a44-8ff8-45e9-aaf4-9da4659e5d30 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:01.152105 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-87ac3a44-8ff8-45e9-aaf4-9da4659e5d30 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:01.152105 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-87ac3a44-8ff8-45e9-aaf4-9da4659e5d30 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:01.152496 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-87ac3a44-8ff8-45e9-aaf4-9da4659e5d30 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:01.152496 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-87ac3a44-8ff8-45e9-aaf4-9da4659e5d30 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:01.356327 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-87ac3a44-8ff8-45e9-aaf4-9da4659e5d30 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:01.356510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1f7aaa9f-43a1-4c58-ac64-5a3fae87cdf8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:01.358847 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-87ac3a44-8ff8-45e9-aaf4-9da4659e5d30 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.240244 Aug 24 16:50:01.372428 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 156/316] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:01 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:01.373140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1f7aaa9f-43a1-4c58-ac64-5a3fae87cdf8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.266069 Aug 24 16:50:01.373140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 161/317] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:01 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:02.382115 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6aef9fca-cc8e-4249-945f-67259c12f065 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:02.382727 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6aef9fca-cc8e-4249-945f-67259c12f065 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:02.384260 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-60a26878-fd60-404a-8ec3-ffbc46dcee7c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:02.385209 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-60a26878-fd60-404a-8ec3-ffbc46dcee7c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:02.391567 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6aef9fca-cc8e-4249-945f-67259c12f065 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:02.392028 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6aef9fca-cc8e-4249-945f-67259c12f065 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:02.392491 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6aef9fca-cc8e-4249-945f-67259c12f065 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:02.393069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60a26878-fd60-404a-8ec3-ffbc46dcee7c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:02.393217 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6aef9fca-cc8e-4249-945f-67259c12f065 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:02.393634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6aef9fca-cc8e-4249-945f-67259c12f065 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:02.394056 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6aef9fca-cc8e-4249-945f-67259c12f065 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:02.394456 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60a26878-fd60-404a-8ec3-ffbc46dcee7c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:02.395224 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60a26878-fd60-404a-8ec3-ffbc46dcee7c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:02.396147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60a26878-fd60-404a-8ec3-ffbc46dcee7c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:02.396672 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60a26878-fd60-404a-8ec3-ffbc46dcee7c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:02.402289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60a26878-fd60-404a-8ec3-ffbc46dcee7c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:02.403921 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:02.598546 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6aef9fca-cc8e-4249-945f-67259c12f065 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:02.600723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-60a26878-fd60-404a-8ec3-ffbc46dcee7c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:02.607109 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6aef9fca-cc8e-4249-945f-67259c12f065 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.228853 Aug 24 16:50:02.607787 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 157/318] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:02 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:02.608853 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-60a26878-fd60-404a-8ec3-ffbc46dcee7c tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.230145 Aug 24 16:50:02.610642 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 162/319] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:02 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:03.629159 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-00edc869-1087-431d-9c30-cd9a214fc47a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:03.629703 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-182f2b5e-98e1-4a93-8d18-66e2a2ed5c17 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:03.630065 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-00edc869-1087-431d-9c30-cd9a214fc47a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:03.630176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-182f2b5e-98e1-4a93-8d18-66e2a2ed5c17 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:03.636043 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-00edc869-1087-431d-9c30-cd9a214fc47a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:03.636615 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-182f2b5e-98e1-4a93-8d18-66e2a2ed5c17 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:03.636749 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-00edc869-1087-431d-9c30-cd9a214fc47a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:03.637090 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-182f2b5e-98e1-4a93-8d18-66e2a2ed5c17 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:03.637196 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-00edc869-1087-431d-9c30-cd9a214fc47a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:03.637661 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-182f2b5e-98e1-4a93-8d18-66e2a2ed5c17 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:03.637859 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-00edc869-1087-431d-9c30-cd9a214fc47a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:03.638355 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-182f2b5e-98e1-4a93-8d18-66e2a2ed5c17 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:03.638466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-00edc869-1087-431d-9c30-cd9a214fc47a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:03.638794 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-00edc869-1087-431d-9c30-cd9a214fc47a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:03.638902 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-182f2b5e-98e1-4a93-8d18-66e2a2ed5c17 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:03.639218 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-182f2b5e-98e1-4a93-8d18-66e2a2ed5c17 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:03.763914 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:03.789128 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=6 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:03.869145 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-182f2b5e-98e1-4a93-8d18-66e2a2ed5c17 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:03.872839 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-00edc869-1087-431d-9c30-cd9a214fc47a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:03.879594 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-182f2b5e-98e1-4a93-8d18-66e2a2ed5c17 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.253617 Aug 24 16:50:03.880840 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 163/320] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:03 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:03.913189 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-00edc869-1087-431d-9c30-cd9a214fc47a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.281988 Aug 24 16:50:03.913189 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 158/321] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:03 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:04.904779 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b4524a70-1765-4aea-b9a7-4893b33f1e46 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:04.905404 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b4524a70-1765-4aea-b9a7-4893b33f1e46 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:04.907223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:04.912166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4524a70-1765-4aea-b9a7-4893b33f1e46 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:04.912689 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4524a70-1765-4aea-b9a7-4893b33f1e46 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:04.913126 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4524a70-1765-4aea-b9a7-4893b33f1e46 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:04.913819 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4524a70-1765-4aea-b9a7-4893b33f1e46 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:04.914310 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4524a70-1765-4aea-b9a7-4893b33f1e46 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:04.914745 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4524a70-1765-4aea-b9a7-4893b33f1e46 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:04.929094 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e53f8319-9665-4579-9599-ce645b85e6f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:04.929926 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e53f8319-9665-4579-9599-ce645b85e6f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:04.939161 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e53f8319-9665-4579-9599-ce645b85e6f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:04.939890 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e53f8319-9665-4579-9599-ce645b85e6f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:04.940585 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e53f8319-9665-4579-9599-ce645b85e6f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:04.941459 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e53f8319-9665-4579-9599-ce645b85e6f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:04.941925 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e53f8319-9665-4579-9599-ce645b85e6f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:04.942352 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e53f8319-9665-4579-9599-ce645b85e6f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:05.124187 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b4524a70-1765-4aea-b9a7-4893b33f1e46 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:05.132067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b4524a70-1765-4aea-b9a7-4893b33f1e46 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.231322 Aug 24 16:50:05.132664 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 164/322] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:04 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:05.133032 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e53f8319-9665-4579-9599-ce645b85e6f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:05.141929 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e53f8319-9665-4579-9599-ce645b85e6f9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.217082 Aug 24 16:50:05.142570 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 159/323] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:04 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:06.153391 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4899d88c-60f5-4c4b-b1e3-48248d816ea6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:06.153927 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4899d88c-60f5-4c4b-b1e3-48248d816ea6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:06.161060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4899d88c-60f5-4c4b-b1e3-48248d816ea6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:06.161563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4899d88c-60f5-4c4b-b1e3-48248d816ea6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:06.161981 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4899d88c-60f5-4c4b-b1e3-48248d816ea6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:06.162822 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4899d88c-60f5-4c4b-b1e3-48248d816ea6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:06.163309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4899d88c-60f5-4c4b-b1e3-48248d816ea6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:06.163750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4899d88c-60f5-4c4b-b1e3-48248d816ea6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:06.171400 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3022cc8e-03f5-41fd-9c79-a41418225672 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:06.172009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3022cc8e-03f5-41fd-9c79-a41418225672 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:06.174744 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:06.179332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3022cc8e-03f5-41fd-9c79-a41418225672 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:06.179812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3022cc8e-03f5-41fd-9c79-a41418225672 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:06.180247 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3022cc8e-03f5-41fd-9c79-a41418225672 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:06.180964 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3022cc8e-03f5-41fd-9c79-a41418225672 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:06.181462 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3022cc8e-03f5-41fd-9c79-a41418225672 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:06.181876 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3022cc8e-03f5-41fd-9c79-a41418225672 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:06.358191 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4899d88c-60f5-4c4b-b1e3-48248d816ea6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:06.366286 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4899d88c-60f5-4c4b-b1e3-48248d816ea6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.217155 Aug 24 16:50:06.366425 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3022cc8e-03f5-41fd-9c79-a41418225672 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:06.366858 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 165/324] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:06 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:06.376294 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3022cc8e-03f5-41fd-9c79-a41418225672 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.209536 Aug 24 16:50:06.381712 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 160/325] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:06 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:07.389235 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9336148e-c352-4780-87b7-b52e0ab5a489 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:07.389862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9336148e-c352-4780-87b7-b52e0ab5a489 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:07.395916 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9336148e-c352-4780-87b7-b52e0ab5a489 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:07.396454 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9336148e-c352-4780-87b7-b52e0ab5a489 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:07.396895 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9336148e-c352-4780-87b7-b52e0ab5a489 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:07.397105 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-cb88df30-6f17-401d-a75d-46add9089fb5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:07.397595 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9336148e-c352-4780-87b7-b52e0ab5a489 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:07.397697 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-cb88df30-6f17-401d-a75d-46add9089fb5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:07.398050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9336148e-c352-4780-87b7-b52e0ab5a489 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:07.398479 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9336148e-c352-4780-87b7-b52e0ab5a489 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:07.407734 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb88df30-6f17-401d-a75d-46add9089fb5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:07.408219 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb88df30-6f17-401d-a75d-46add9089fb5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:07.408694 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb88df30-6f17-401d-a75d-46add9089fb5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:07.409543 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb88df30-6f17-401d-a75d-46add9089fb5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:07.409997 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb88df30-6f17-401d-a75d-46add9089fb5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:07.410416 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb88df30-6f17-401d-a75d-46add9089fb5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:07.603709 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9336148e-c352-4780-87b7-b52e0ab5a489 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:07.606986 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cb88df30-6f17-401d-a75d-46add9089fb5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:07.612887 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9336148e-c352-4780-87b7-b52e0ab5a489 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.228240 Aug 24 16:50:07.613465 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 166/326] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:07 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:07.614867 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-cb88df30-6f17-401d-a75d-46add9089fb5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.221478 Aug 24 16:50:07.615586 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 161/327] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:07 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:08.633948 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9df435c3-6370-4255-8ba0-944eb8b4f128 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:08.634564 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9df435c3-6370-4255-8ba0-944eb8b4f128 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:08.635452 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1624f096-57c3-4096-81ae-5d09e1828792 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:08.636071 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1624f096-57c3-4096-81ae-5d09e1828792 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:08.641015 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9df435c3-6370-4255-8ba0-944eb8b4f128 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:08.641503 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9df435c3-6370-4255-8ba0-944eb8b4f128 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:08.641938 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9df435c3-6370-4255-8ba0-944eb8b4f128 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:08.642625 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9df435c3-6370-4255-8ba0-944eb8b4f128 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:08.642954 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1624f096-57c3-4096-81ae-5d09e1828792 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:08.643086 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9df435c3-6370-4255-8ba0-944eb8b4f128 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:08.643432 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1624f096-57c3-4096-81ae-5d09e1828792 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:08.643571 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9df435c3-6370-4255-8ba0-944eb8b4f128 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:08.643872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1624f096-57c3-4096-81ae-5d09e1828792 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:08.644618 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1624f096-57c3-4096-81ae-5d09e1828792 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:08.645079 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1624f096-57c3-4096-81ae-5d09e1828792 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:08.645507 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1624f096-57c3-4096-81ae-5d09e1828792 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:08.835930 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9df435c3-6370-4255-8ba0-944eb8b4f128 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:08.839869 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1624f096-57c3-4096-81ae-5d09e1828792 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:08.843785 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9df435c3-6370-4255-8ba0-944eb8b4f128 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.213935 Aug 24 16:50:08.844537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 167/328] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:08 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:08.847719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1624f096-57c3-4096-81ae-5d09e1828792 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.215983 Aug 24 16:50:08.848272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 162/329] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:08 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:09.863911 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1a35f31b-5aa2-4a9d-b3a3-bcf208118880 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:09.864682 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1a35f31b-5aa2-4a9d-b3a3-bcf208118880 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:09.868373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c0a74be9-6361-4789-b3bc-f4936c760a10 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:09.869009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c0a74be9-6361-4789-b3bc-f4936c760a10 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:09.872800 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a35f31b-5aa2-4a9d-b3a3-bcf208118880 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:09.878881 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a35f31b-5aa2-4a9d-b3a3-bcf208118880 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:09.878881 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a35f31b-5aa2-4a9d-b3a3-bcf208118880 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:09.878881 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a35f31b-5aa2-4a9d-b3a3-bcf208118880 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:09.878881 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a35f31b-5aa2-4a9d-b3a3-bcf208118880 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:09.879466 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a35f31b-5aa2-4a9d-b3a3-bcf208118880 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:09.879557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c0a74be9-6361-4789-b3bc-f4936c760a10 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:09.879557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c0a74be9-6361-4789-b3bc-f4936c760a10 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:09.879557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c0a74be9-6361-4789-b3bc-f4936c760a10 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:09.879557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c0a74be9-6361-4789-b3bc-f4936c760a10 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:09.879917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c0a74be9-6361-4789-b3bc-f4936c760a10 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:09.879917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c0a74be9-6361-4789-b3bc-f4936c760a10 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:10.078558 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c0a74be9-6361-4789-b3bc-f4936c760a10 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:10.081347 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1a35f31b-5aa2-4a9d-b3a3-bcf208118880 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:10.086461 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c0a74be9-6361-4789-b3bc-f4936c760a10 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.222173 Aug 24 16:50:10.090480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 163/330] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:09 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:10.090599 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1a35f31b-5aa2-4a9d-b3a3-bcf208118880 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.230486 Aug 24 16:50:10.090963 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 168/331] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:09 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:11.107973 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9a205d73-f231-44f6-955e-56d57646f661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:11.108632 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9a205d73-f231-44f6-955e-56d57646f661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:11.111032 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c0f851b2-3da5-4e6c-9f31-32cefd49c465 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:11.111651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c0f851b2-3da5-4e6c-9f31-32cefd49c465 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:11.115274 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a205d73-f231-44f6-955e-56d57646f661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:11.115759 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a205d73-f231-44f6-955e-56d57646f661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:11.116199 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a205d73-f231-44f6-955e-56d57646f661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:11.116912 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a205d73-f231-44f6-955e-56d57646f661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:11.117368 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a205d73-f231-44f6-955e-56d57646f661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:11.117477 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c0f851b2-3da5-4e6c-9f31-32cefd49c465 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:11.117793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a205d73-f231-44f6-955e-56d57646f661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:11.117962 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c0f851b2-3da5-4e6c-9f31-32cefd49c465 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:11.118403 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c0f851b2-3da5-4e6c-9f31-32cefd49c465 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:11.119128 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c0f851b2-3da5-4e6c-9f31-32cefd49c465 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:11.119582 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c0f851b2-3da5-4e6c-9f31-32cefd49c465 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:11.120276 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c0f851b2-3da5-4e6c-9f31-32cefd49c465 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:11.312539 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9a205d73-f231-44f6-955e-56d57646f661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:11.316201 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c0f851b2-3da5-4e6c-9f31-32cefd49c465 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:11.320284 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9a205d73-f231-44f6-955e-56d57646f661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.217014 Aug 24 16:50:11.320963 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 164/332] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:11 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:11.324215 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c0f851b2-3da5-4e6c-9f31-32cefd49c465 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.217486 Aug 24 16:50:11.324879 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 169/333] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:11 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:11.756787 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-7359e9f3-0733-4687-ae66-334e28e9caf3 req-c369fb5a-a20a-42fc-ae80-e068d6fdf5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb816b7-df6d-4661-a949-791633431051", "name": "network-vif-plugged", "status": "completed", "tag": "00850e15-8b1a-4ef1-859a-2df0388a711a"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:11.766772 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-7359e9f3-0733-4687-ae66-334e28e9caf3 req-c369fb5a-a20a-42fc-ae80-e068d6fdf5d2 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:11.767246 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-7359e9f3-0733-4687-ae66-334e28e9caf3 req-c369fb5a-a20a-42fc-ae80-e068d6fdf5d2 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:11.767674 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-7359e9f3-0733-4687-ae66-334e28e9caf3 req-c369fb5a-a20a-42fc-ae80-e068d6fdf5d2 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:11.778692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-7359e9f3-0733-4687-ae66-334e28e9caf3 req-c369fb5a-a20a-42fc-ae80-e068d6fdf5d2 service nova] Creating event network-vif-plugged:00850e15-8b1a-4ef1-859a-2df0388a711a for instance 5cb816b7-df6d-4661-a949-791633431051 on hv-cinder-85220 Aug 24 16:50:11.783882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-7359e9f3-0733-4687-ae66-334e28e9caf3 req-c369fb5a-a20a-42fc-ae80-e068d6fdf5d2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031176 Aug 24 16:50:11.784497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 165/334] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:12.342319 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6e7da240-f963-4793-a3f3-a331f08e1661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:12.342816 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6e7da240-f963-4793-a3f3-a331f08e1661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:12.346801 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f7e5e8af-1a4b-4d5a-b60b-366612f9dd9d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:12.347534 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f7e5e8af-1a4b-4d5a-b60b-366612f9dd9d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:12.348678 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e7da240-f963-4793-a3f3-a331f08e1661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:12.349154 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e7da240-f963-4793-a3f3-a331f08e1661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:12.349579 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e7da240-f963-4793-a3f3-a331f08e1661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:12.350260 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e7da240-f963-4793-a3f3-a331f08e1661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:12.350704 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e7da240-f963-4793-a3f3-a331f08e1661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:12.351171 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e7da240-f963-4793-a3f3-a331f08e1661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:12.354184 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f7e5e8af-1a4b-4d5a-b60b-366612f9dd9d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:12.354664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f7e5e8af-1a4b-4d5a-b60b-366612f9dd9d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:12.355101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f7e5e8af-1a4b-4d5a-b60b-366612f9dd9d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:12.355785 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f7e5e8af-1a4b-4d5a-b60b-366612f9dd9d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:12.356249 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f7e5e8af-1a4b-4d5a-b60b-366612f9dd9d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:12.356702 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f7e5e8af-1a4b-4d5a-b60b-366612f9dd9d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:12.543215 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f7e5e8af-1a4b-4d5a-b60b-366612f9dd9d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:12.547339 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6e7da240-f963-4793-a3f3-a331f08e1661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:12.551060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f7e5e8af-1a4b-4d5a-b60b-366612f9dd9d tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.209611 Aug 24 16:50:12.551635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 166/335] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:12 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:12.555087 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6e7da240-f963-4793-a3f3-a331f08e1661 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.217292 Aug 24 16:50:12.555632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 170/336] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:12 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:13.571101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-cb9a87ce-74ce-4312-859d-928da9c3ccc1 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:13.572287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-cb9a87ce-74ce-4312-859d-928da9c3ccc1 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:13.576790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-15f3eccb-f486-4e43-aadf-142cae879b6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:13.577551 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-15f3eccb-f486-4e43-aadf-142cae879b6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:13.579236 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb9a87ce-74ce-4312-859d-928da9c3ccc1 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:13.579722 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb9a87ce-74ce-4312-859d-928da9c3ccc1 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:13.580159 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb9a87ce-74ce-4312-859d-928da9c3ccc1 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:13.580891 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb9a87ce-74ce-4312-859d-928da9c3ccc1 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:13.581350 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb9a87ce-74ce-4312-859d-928da9c3ccc1 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:13.581778 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb9a87ce-74ce-4312-859d-928da9c3ccc1 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:13.583526 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-15f3eccb-f486-4e43-aadf-142cae879b6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:13.584090 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-15f3eccb-f486-4e43-aadf-142cae879b6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:13.584512 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-15f3eccb-f486-4e43-aadf-142cae879b6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:13.585232 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-15f3eccb-f486-4e43-aadf-142cae879b6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:13.585715 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-15f3eccb-f486-4e43-aadf-142cae879b6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:13.586137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-15f3eccb-f486-4e43-aadf-142cae879b6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:13.771983 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cb9a87ce-74ce-4312-859d-928da9c3ccc1 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:13.781536 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-cb9a87ce-74ce-4312-859d-928da9c3ccc1 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1313 microversion: 2.1 time: 0.214262 Aug 24 16:50:13.784866 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-15f3eccb-f486-4e43-aadf-142cae879b6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:13.793782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 167/337] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:13 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:13.795779 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-15f3eccb-f486-4e43-aadf-142cae879b6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.223262 Aug 24 16:50:13.796777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 171/338] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:13 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:14.802615 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0a3c4f4e-8fce-4e72-a92c-2f92c9ab5727 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:14.803353 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0a3c4f4e-8fce-4e72-a92c-2f92c9ab5727 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:14.809873 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0a3c4f4e-8fce-4e72-a92c-2f92c9ab5727 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:14.810357 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0a3c4f4e-8fce-4e72-a92c-2f92c9ab5727 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:14.810792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0a3c4f4e-8fce-4e72-a92c-2f92c9ab5727 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:14.811480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0a3c4f4e-8fce-4e72-a92c-2f92c9ab5727 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:14.811938 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0a3c4f4e-8fce-4e72-a92c-2f92c9ab5727 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:14.812363 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0a3c4f4e-8fce-4e72-a92c-2f92c9ab5727 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:14.818007 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-045c3837-d04a-46b1-ba6a-714c5875a53a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:14.818617 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-045c3837-d04a-46b1-ba6a-714c5875a53a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:14.824450 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-045c3837-d04a-46b1-ba6a-714c5875a53a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:14.824951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-045c3837-d04a-46b1-ba6a-714c5875a53a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:14.825361 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-045c3837-d04a-46b1-ba6a-714c5875a53a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:14.826046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-045c3837-d04a-46b1-ba6a-714c5875a53a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:14.826493 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-045c3837-d04a-46b1-ba6a-714c5875a53a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:14.826907 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-045c3837-d04a-46b1-ba6a-714c5875a53a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:14.998036 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0a3c4f4e-8fce-4e72-a92c-2f92c9ab5727 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:15.005705 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0a3c4f4e-8fce-4e72-a92c-2f92c9ab5727 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1498 microversion: 2.1 time: 0.206924 Aug 24 16:50:15.006267 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 168/339] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:14 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1498 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:15.014726 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-045c3837-d04a-46b1-ba6a-714c5875a53a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:15.022438 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-045c3837-d04a-46b1-ba6a-714c5875a53a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.208210 Aug 24 16:50:15.023009 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 172/340] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:14 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:16.043151 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a79274d7-1934-4ce3-86c9-3612c029be09 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:16.044073 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a79274d7-1934-4ce3-86c9-3612c029be09 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:16.051034 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a79274d7-1934-4ce3-86c9-3612c029be09 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:16.054408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a79274d7-1934-4ce3-86c9-3612c029be09 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:16.054408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a79274d7-1934-4ce3-86c9-3612c029be09 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:16.054408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a79274d7-1934-4ce3-86c9-3612c029be09 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:16.054408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a79274d7-1934-4ce3-86c9-3612c029be09 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:16.054856 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a79274d7-1934-4ce3-86c9-3612c029be09 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:16.104042 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0428ba6f-ee37-4fa7-b29d-5e2e675699fd tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:16.106159 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0428ba6f-ee37-4fa7-b29d-5e2e675699fd tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:16.111589 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0428ba6f-ee37-4fa7-b29d-5e2e675699fd tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:16.112080 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0428ba6f-ee37-4fa7-b29d-5e2e675699fd tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:16.112668 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0428ba6f-ee37-4fa7-b29d-5e2e675699fd tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:16.113371 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0428ba6f-ee37-4fa7-b29d-5e2e675699fd tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:16.113829 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0428ba6f-ee37-4fa7-b29d-5e2e675699fd tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:16.114256 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0428ba6f-ee37-4fa7-b29d-5e2e675699fd tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:16.142287 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0428ba6f-ee37-4fa7-b29d-5e2e675699fd tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:50:16.206511 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a79274d7-1934-4ce3-86c9-3612c029be09 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:16.214295 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a79274d7-1934-4ce3-86c9-3612c029be09 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.174923 Aug 24 16:50:16.219208 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 169/341] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:16 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:16.498021 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0428ba6f-ee37-4fa7-b29d-5e2e675699fd tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 204 len: 0 microversion: 2.1 time: 0.398709 Aug 24 16:50:16.498638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 173/342] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:50:16 2022] DELETE /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:16.506933 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-176f5c6c-5bf6-40dc-956d-469a7262d4ff tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:16.508763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-176f5c6c-5bf6-40dc-956d-469a7262d4ff tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:16.513727 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-176f5c6c-5bf6-40dc-956d-469a7262d4ff tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:16.514216 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-176f5c6c-5bf6-40dc-956d-469a7262d4ff tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:16.514755 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-176f5c6c-5bf6-40dc-956d-469a7262d4ff tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:16.515454 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-176f5c6c-5bf6-40dc-956d-469a7262d4ff tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:16.515912 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-176f5c6c-5bf6-40dc-956d-469a7262d4ff tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:16.516342 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-176f5c6c-5bf6-40dc-956d-469a7262d4ff tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:16.655197 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-176f5c6c-5bf6-40dc-956d-469a7262d4ff tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:16.662898 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-176f5c6c-5bf6-40dc-956d-469a7262d4ff tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1504 microversion: 2.1 time: 0.159738 Aug 24 16:50:16.663666 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 170/343] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:16 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:17.236092 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fc4718f5-5992-438a-a304-222b3f9277f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:17.236933 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fc4718f5-5992-438a-a304-222b3f9277f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:17.244141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fc4718f5-5992-438a-a304-222b3f9277f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:17.244141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fc4718f5-5992-438a-a304-222b3f9277f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:17.244141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fc4718f5-5992-438a-a304-222b3f9277f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:17.244374 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fc4718f5-5992-438a-a304-222b3f9277f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:17.244758 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fc4718f5-5992-438a-a304-222b3f9277f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:17.245440 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fc4718f5-5992-438a-a304-222b3f9277f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:17.389461 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fc4718f5-5992-438a-a304-222b3f9277f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:17.397199 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fc4718f5-5992-438a-a304-222b3f9277f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.165327 Aug 24 16:50:17.397760 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 174/344] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:17 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:17.684319 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-74603fc8-8c33-4751-8d97-98b4d5c57ecf tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:17.684962 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-74603fc8-8c33-4751-8d97-98b4d5c57ecf tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:17.691255 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-74603fc8-8c33-4751-8d97-98b4d5c57ecf tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:17.691739 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-74603fc8-8c33-4751-8d97-98b4d5c57ecf tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:17.692174 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-74603fc8-8c33-4751-8d97-98b4d5c57ecf tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:17.692901 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-74603fc8-8c33-4751-8d97-98b4d5c57ecf tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:17.693355 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-74603fc8-8c33-4751-8d97-98b4d5c57ecf tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:17.693781 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-74603fc8-8c33-4751-8d97-98b4d5c57ecf tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:17.697847 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:17.824790 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-74603fc8-8c33-4751-8d97-98b4d5c57ecf tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:17.832566 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-74603fc8-8c33-4751-8d97-98b4d5c57ecf tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1504 microversion: 2.1 time: 0.152029 Aug 24 16:50:17.839323 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 171/345] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:17 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:18.423367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-adc6ceee-e8da-4d1b-8245-8c42e0534649 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:18.423367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-adc6ceee-e8da-4d1b-8245-8c42e0534649 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:18.425827 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-adc6ceee-e8da-4d1b-8245-8c42e0534649 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:18.426422 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-adc6ceee-e8da-4d1b-8245-8c42e0534649 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:18.427040 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-adc6ceee-e8da-4d1b-8245-8c42e0534649 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:18.427932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-adc6ceee-e8da-4d1b-8245-8c42e0534649 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:18.428563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-adc6ceee-e8da-4d1b-8245-8c42e0534649 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:18.428994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-adc6ceee-e8da-4d1b-8245-8c42e0534649 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:18.568586 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-adc6ceee-e8da-4d1b-8245-8c42e0534649 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:18.576939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-adc6ceee-e8da-4d1b-8245-8c42e0534649 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.163228 Aug 24 16:50:18.577513 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 175/346] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:18 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:18.854599 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-684de5c1-4b95-41d4-87c3-75f4e8dc543f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:18.855208 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-684de5c1-4b95-41d4-87c3-75f4e8dc543f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:18.862113 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-684de5c1-4b95-41d4-87c3-75f4e8dc543f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:18.862598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-684de5c1-4b95-41d4-87c3-75f4e8dc543f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:18.863036 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-684de5c1-4b95-41d4-87c3-75f4e8dc543f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:18.863720 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-684de5c1-4b95-41d4-87c3-75f4e8dc543f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:18.864174 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-684de5c1-4b95-41d4-87c3-75f4e8dc543f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:18.864627 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-684de5c1-4b95-41d4-87c3-75f4e8dc543f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:18.991579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-684de5c1-4b95-41d4-87c3-75f4e8dc543f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:19.000526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-684de5c1-4b95-41d4-87c3-75f4e8dc543f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1504 microversion: 2.1 time: 0.149758 Aug 24 16:50:19.001062 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 172/347] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:18 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:19.599479 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7bfd3faf-e28b-4131-99e3-c4ebd4e76c61 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:19.601084 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7bfd3faf-e28b-4131-99e3-c4ebd4e76c61 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:19.608517 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7bfd3faf-e28b-4131-99e3-c4ebd4e76c61 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:19.609265 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7bfd3faf-e28b-4131-99e3-c4ebd4e76c61 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:19.610084 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7bfd3faf-e28b-4131-99e3-c4ebd4e76c61 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:19.611516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7bfd3faf-e28b-4131-99e3-c4ebd4e76c61 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:19.612510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7bfd3faf-e28b-4131-99e3-c4ebd4e76c61 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:19.613396 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7bfd3faf-e28b-4131-99e3-c4ebd4e76c61 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:19.791491 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7bfd3faf-e28b-4131-99e3-c4ebd4e76c61 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:19.801480 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7bfd3faf-e28b-4131-99e3-c4ebd4e76c61 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1522 microversion: 2.1 time: 0.206923 Aug 24 16:50:19.802050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 176/348] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:19 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:19.807188 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-586226ab-5936-4403-8282-09a104a08bac req-aed7a4b0-3a5f-4567-8ecc-356f12edfb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb816b7-df6d-4661-a949-791633431051", "name": "network-vif-deleted", "tag": "00850e15-8b1a-4ef1-859a-2df0388a711a"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:19.817228 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-586226ab-5936-4403-8282-09a104a08bac req-aed7a4b0-3a5f-4567-8ecc-356f12edfb13 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:19.817707 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-586226ab-5936-4403-8282-09a104a08bac req-aed7a4b0-3a5f-4567-8ecc-356f12edfb13 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:19.818136 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-586226ab-5936-4403-8282-09a104a08bac req-aed7a4b0-3a5f-4567-8ecc-356f12edfb13 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:19.828916 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-586226ab-5936-4403-8282-09a104a08bac req-aed7a4b0-3a5f-4567-8ecc-356f12edfb13 service nova] Creating event network-vif-deleted:00850e15-8b1a-4ef1-859a-2df0388a711a for instance 5cb816b7-df6d-4661-a949-791633431051 on hv-cinder-85220 Aug 24 16:50:19.834225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-586226ab-5936-4403-8282-09a104a08bac req-aed7a4b0-3a5f-4567-8ecc-356f12edfb13 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032603 Aug 24 16:50:19.834872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 173/349] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:50:20.023428 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3350a68b-b5bd-41c6-b542-eecb07c08017 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:20.024268 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3350a68b-b5bd-41c6-b542-eecb07c08017 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:20.031217 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3350a68b-b5bd-41c6-b542-eecb07c08017 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:20.031715 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3350a68b-b5bd-41c6-b542-eecb07c08017 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:20.032139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3350a68b-b5bd-41c6-b542-eecb07c08017 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:20.033087 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3350a68b-b5bd-41c6-b542-eecb07c08017 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:20.033561 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3350a68b-b5bd-41c6-b542-eecb07c08017 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:20.033972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3350a68b-b5bd-41c6-b542-eecb07c08017 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:20.037177 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:20.112613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3350a68b-b5bd-41c6-b542-eecb07c08017 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:20.125080 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3350a68b-b5bd-41c6-b542-eecb07c08017 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1462 microversion: 2.1 time: 0.106598 Aug 24 16:50:20.126075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 177/350] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:20 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1462 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:20.823144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-75b01b57-7e8c-427b-bfd8-f266d9d15f5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:20.824039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-75b01b57-7e8c-427b-bfd8-f266d9d15f5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:20.830645 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-75b01b57-7e8c-427b-bfd8-f266d9d15f5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:20.831131 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-75b01b57-7e8c-427b-bfd8-f266d9d15f5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:20.831809 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-75b01b57-7e8c-427b-bfd8-f266d9d15f5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:20.832586 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-75b01b57-7e8c-427b-bfd8-f266d9d15f5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:20.833039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-75b01b57-7e8c-427b-bfd8-f266d9d15f5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:20.833466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-75b01b57-7e8c-427b-bfd8-f266d9d15f5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:20.969052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-75b01b57-7e8c-427b-bfd8-f266d9d15f5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:20.976967 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-75b01b57-7e8c-427b-bfd8-f266d9d15f5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1502 microversion: 2.1 time: 0.158934 Aug 24 16:50:20.977529 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 174/351] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:20 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:20.997456 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a580d918-9ad0-4451-9e36-1cb9e191ffb8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:20.998662 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a580d918-9ad0-4451-9e36-1cb9e191ffb8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:21.005566 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a580d918-9ad0-4451-9e36-1cb9e191ffb8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:21.006129 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a580d918-9ad0-4451-9e36-1cb9e191ffb8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:21.006569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a580d918-9ad0-4451-9e36-1cb9e191ffb8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:21.007252 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a580d918-9ad0-4451-9e36-1cb9e191ffb8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:21.007706 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a580d918-9ad0-4451-9e36-1cb9e191ffb8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:21.008129 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a580d918-9ad0-4451-9e36-1cb9e191ffb8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:21.146974 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a580d918-9ad0-4451-9e36-1cb9e191ffb8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:21.148918 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:21.149598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:21.155459 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:21.155943 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:21.156378 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:21.157124 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:21.157583 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:21.157693 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a580d918-9ad0-4451-9e36-1cb9e191ffb8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1514 microversion: 2.1 time: 0.163850 Aug 24 16:50:21.158007 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:21.159452 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 178/352] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:20 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:21.193088 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:21.193615 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:21.194055 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:21.198165 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lazy-loading 'fault' on Instance uuid 5cb816b7-df6d-4661-a949-791633431051 {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:50:21.241310 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55975de527254dca90fc4f30bc50e393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5a0fa1909747368101df31693c44e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:21.251798 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-eabc6737-15e5-4759-97d2-91d03159a94f tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 200 len: 1303 microversion: 2.1 time: 0.106698 Aug 24 16:50:21.254402 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 175/353] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:21 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:22.282521 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6f6e6691-2427-4ea6-a3e6-372809d02de6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:22.282521 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6f6e6691-2427-4ea6-a3e6-372809d02de6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] [instance: 5cb816b7-df6d-4661-a949-791633431051] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:22.283628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f6e6691-2427-4ea6-a3e6-372809d02de6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:22.283628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f6e6691-2427-4ea6-a3e6-372809d02de6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:22.283774 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f6e6691-2427-4ea6-a3e6-372809d02de6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:22.284381 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f6e6691-2427-4ea6-a3e6-372809d02de6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:22.285441 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f6e6691-2427-4ea6-a3e6-372809d02de6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:22.285864 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f6e6691-2427-4ea6-a3e6-372809d02de6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:22.300546 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-6f6e6691-2427-4ea6-a3e6-372809d02de6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] HTTP exception thrown: Instance 5cb816b7-df6d-4661-a949-791633431051 could not be found. Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6f6e6691-2427-4ea6-a3e6-372809d02de6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Request method failure captured: Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 HTTP/1.1 Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlaRHyYaK6_iXwqn-sY7Vd_zjphZaQ5h0lyVHXe097K6JIx1omOUdDiOl3XC8I11wY1rcluCXoKvK7SiMhLNvInWKUktKHUhRwo8zAG5wKHiC0JXd8ks8RhxeUwzAKtx5pSrZ_btWv3w0w_JL-JIux1i-zBim4xOvidDXAc37t_55-o Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: cd5a0fa1909747368101df31693c44e1 Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-VolumesActionsTest-1724408736 Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:50:22.302924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:50:22.304271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd5a0fa1909747368101df31693c44e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd5a0fa1909747368101df31693c44e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd5a0fa1909747368101df31693c44e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd5a0fa1909747368101df31693c44e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:50:22.304271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-VolumesActionsTest-1724408736 Aug 24 16:50:22.304271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: cd5a0fa1909747368101df31693c44e1 Aug 24 16:50:22.304271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-VolumesActionsTest-1724408736 Aug 24 16:50:22.304271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-VolumesActionsTest-1724408736-project Aug 24 16:50:22.304271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:50:22.304271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:50:22.304271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 55975de527254dca90fc4f30bc50e393 Aug 24 16:50:22.304271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-VolumesActionsTest-1724408736-project Aug 24 16:50:22.304271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:50:22.304271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 5cb816b7-df6d-4661-a949-791633431051 could not be found. Aug 24 16:50:22.304271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '5cb816b7-df6d-4661-a949-791633431051'} Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb816b7-df6d-4661-a949-791633431051 could not be found. Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:22.306249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb816b7-df6d-4661-a949-791633431051 could not be found. Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb816b7-df6d-4661-a949-791633431051 could not be found. Aug 24 16:50:22.307638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:50:22.308760 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6f6e6691-2427-4ea6-a3e6-372809d02de6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] Returning 404 to user: Instance 5cb816b7-df6d-4661-a949-791633431051 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:22.308760 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6f6e6691-2427-4ea6-a3e6-372809d02de6 tempest-VolumesActionsTest-1724408736 tempest-VolumesActionsTest-1724408736-project] 10.222.0.70 "GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051" status: 404 len: 111 microversion: 2.1 time: 0.033140 Aug 24 16:50:22.308760 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 179/354] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:22 2022] GET /compute/v2.1/servers/5cb816b7-df6d-4661-a949-791633431051 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:50:27.244768 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b6ba160a-07d3-4d03-8399-163d9654d105 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:27.247215 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b6ba160a-07d3-4d03-8399-163d9654d105 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:27.254729 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b6ba160a-07d3-4d03-8399-163d9654d105 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:27.255221 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b6ba160a-07d3-4d03-8399-163d9654d105 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:27.255663 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b6ba160a-07d3-4d03-8399-163d9654d105 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:27.256389 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b6ba160a-07d3-4d03-8399-163d9654d105 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:27.256880 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b6ba160a-07d3-4d03-8399-163d9654d105 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:27.257409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b6ba160a-07d3-4d03-8399-163d9654d105 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:27.280939 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-b6ba160a-07d3-4d03-8399-163d9654d105 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lazy-loading 'flavor' on Instance uuid dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:50:27.605380 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b6ba160a-07d3-4d03-8399-163d9654d105 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "POST /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b/action" status: 200 len: 32 microversion: 2.1 time: 0.364487 Aug 24 16:50:27.605981 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 176/355] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 16:50:27 2022] POST /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b/action => generated 32 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:50:27.616235 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f2ccfdc3-5118-446d-81d4-ab0f0b29db29 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:27.616871 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f2ccfdc3-5118-446d-81d4-ab0f0b29db29 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:27.618912 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:27.624308 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2ccfdc3-5118-446d-81d4-ab0f0b29db29 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:27.624841 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2ccfdc3-5118-446d-81d4-ab0f0b29db29 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:27.625276 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2ccfdc3-5118-446d-81d4-ab0f0b29db29 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:27.625998 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2ccfdc3-5118-446d-81d4-ab0f0b29db29 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:27.626451 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2ccfdc3-5118-446d-81d4-ab0f0b29db29 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:27.626875 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2ccfdc3-5118-446d-81d4-ab0f0b29db29 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:27.752084 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f2ccfdc3-5118-446d-81d4-ab0f0b29db29 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:27.759906 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f2ccfdc3-5118-446d-81d4-ab0f0b29db29 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.147804 Aug 24 16:50:27.760493 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 180/356] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:27 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:28.783153 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ab757af7-e4ec-4d34-a682-b861e11af5b2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:28.783848 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ab757af7-e4ec-4d34-a682-b861e11af5b2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:28.790452 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab757af7-e4ec-4d34-a682-b861e11af5b2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:28.790938 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab757af7-e4ec-4d34-a682-b861e11af5b2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:28.791368 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab757af7-e4ec-4d34-a682-b861e11af5b2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:28.792048 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab757af7-e4ec-4d34-a682-b861e11af5b2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:28.792523 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab757af7-e4ec-4d34-a682-b861e11af5b2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:28.792946 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab757af7-e4ec-4d34-a682-b861e11af5b2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:28.921293 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ab757af7-e4ec-4d34-a682-b861e11af5b2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:28.929002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ab757af7-e4ec-4d34-a682-b861e11af5b2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.151204 Aug 24 16:50:28.929579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 177/357] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:28 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:29.949753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d7bfabab-fbc9-450b-8574-0a2198479af6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:29.950372 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d7bfabab-fbc9-450b-8574-0a2198479af6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:29.956812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7bfabab-fbc9-450b-8574-0a2198479af6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:29.957292 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7bfabab-fbc9-450b-8574-0a2198479af6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:29.957724 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7bfabab-fbc9-450b-8574-0a2198479af6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:29.958416 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7bfabab-fbc9-450b-8574-0a2198479af6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:29.958905 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7bfabab-fbc9-450b-8574-0a2198479af6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:29.959328 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7bfabab-fbc9-450b-8574-0a2198479af6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:30.083346 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d7bfabab-fbc9-450b-8574-0a2198479af6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:30.090913 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d7bfabab-fbc9-450b-8574-0a2198479af6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.144975 Aug 24 16:50:30.091479 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 181/358] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:29 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:31.112043 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-05127730-7e8b-40ef-8c74-d1d1dd414b27 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:31.112674 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-05127730-7e8b-40ef-8c74-d1d1dd414b27 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:31.119073 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05127730-7e8b-40ef-8c74-d1d1dd414b27 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:31.119557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05127730-7e8b-40ef-8c74-d1d1dd414b27 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:31.119989 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05127730-7e8b-40ef-8c74-d1d1dd414b27 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:31.120958 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05127730-7e8b-40ef-8c74-d1d1dd414b27 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:31.121403 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05127730-7e8b-40ef-8c74-d1d1dd414b27 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:31.121822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05127730-7e8b-40ef-8c74-d1d1dd414b27 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:31.276622 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-05127730-7e8b-40ef-8c74-d1d1dd414b27 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:31.285148 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-05127730-7e8b-40ef-8c74-d1d1dd414b27 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.177459 Aug 24 16:50:31.285749 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 178/359] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:31 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:32.306939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4a5abebc-825c-42a7-8a68-61ea0674db98 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:32.307502 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4a5abebc-825c-42a7-8a68-61ea0674db98 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:32.313492 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a5abebc-825c-42a7-8a68-61ea0674db98 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:32.313963 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a5abebc-825c-42a7-8a68-61ea0674db98 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:32.314391 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a5abebc-825c-42a7-8a68-61ea0674db98 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:32.315066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a5abebc-825c-42a7-8a68-61ea0674db98 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:32.315585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a5abebc-825c-42a7-8a68-61ea0674db98 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:32.315927 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a5abebc-825c-42a7-8a68-61ea0674db98 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:32.438966 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4a5abebc-825c-42a7-8a68-61ea0674db98 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:32.446514 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4a5abebc-825c-42a7-8a68-61ea0674db98 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.143581 Aug 24 16:50:32.447072 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 182/360] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:32 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:33.467951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3509d0ea-7450-4f13-b196-a0bbaacd0a25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:33.469053 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3509d0ea-7450-4f13-b196-a0bbaacd0a25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:33.475451 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3509d0ea-7450-4f13-b196-a0bbaacd0a25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:33.476162 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3509d0ea-7450-4f13-b196-a0bbaacd0a25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:33.476801 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3509d0ea-7450-4f13-b196-a0bbaacd0a25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:33.477788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3509d0ea-7450-4f13-b196-a0bbaacd0a25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:33.478220 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3509d0ea-7450-4f13-b196-a0bbaacd0a25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:33.478644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3509d0ea-7450-4f13-b196-a0bbaacd0a25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:33.641489 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3509d0ea-7450-4f13-b196-a0bbaacd0a25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:33.649977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3509d0ea-7450-4f13-b196-a0bbaacd0a25 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.186423 Aug 24 16:50:33.651074 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 179/361] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:33 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:34.676213 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-129d1e47-69e7-41c9-a0db-9c021e60fafd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:34.676967 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-129d1e47-69e7-41c9-a0db-9c021e60fafd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:34.683289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-129d1e47-69e7-41c9-a0db-9c021e60fafd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:34.684068 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-129d1e47-69e7-41c9-a0db-9c021e60fafd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:34.684560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-129d1e47-69e7-41c9-a0db-9c021e60fafd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:34.685226 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-129d1e47-69e7-41c9-a0db-9c021e60fafd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:34.685695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-129d1e47-69e7-41c9-a0db-9c021e60fafd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:34.686121 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-129d1e47-69e7-41c9-a0db-9c021e60fafd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:34.852826 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-129d1e47-69e7-41c9-a0db-9c021e60fafd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:34.864897 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-129d1e47-69e7-41c9-a0db-9c021e60fafd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.193103 Aug 24 16:50:34.880992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 183/362] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:34 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:35.894925 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-aff7b317-d9b9-4f4b-99de-314583428405 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:35.904633 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-aff7b317-d9b9-4f4b-99de-314583428405 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:35.904633 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aff7b317-d9b9-4f4b-99de-314583428405 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:35.904633 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aff7b317-d9b9-4f4b-99de-314583428405 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:35.904633 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aff7b317-d9b9-4f4b-99de-314583428405 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:35.905043 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aff7b317-d9b9-4f4b-99de-314583428405 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:35.905043 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aff7b317-d9b9-4f4b-99de-314583428405 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:35.905043 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aff7b317-d9b9-4f4b-99de-314583428405 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:36.037175 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-aff7b317-d9b9-4f4b-99de-314583428405 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:36.055992 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-aff7b317-d9b9-4f4b-99de-314583428405 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.166030 Aug 24 16:50:36.056976 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 180/363] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:35 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:37.089176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e3e3dcb7-bc5c-42d3-b15d-44743ae7ebd0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:37.090946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e3e3dcb7-bc5c-42d3-b15d-44743ae7ebd0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:37.101839 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3e3dcb7-bc5c-42d3-b15d-44743ae7ebd0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:37.103140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3e3dcb7-bc5c-42d3-b15d-44743ae7ebd0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:37.104458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3e3dcb7-bc5c-42d3-b15d-44743ae7ebd0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:37.106034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3e3dcb7-bc5c-42d3-b15d-44743ae7ebd0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:37.107011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3e3dcb7-bc5c-42d3-b15d-44743ae7ebd0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:37.107992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3e3dcb7-bc5c-42d3-b15d-44743ae7ebd0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:37.304701 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e3e3dcb7-bc5c-42d3-b15d-44743ae7ebd0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:37.319241 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e3e3dcb7-bc5c-42d3-b15d-44743ae7ebd0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.237320 Aug 24 16:50:37.330851 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 184/364] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:37 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:38.348047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-88d45478-959f-40ec-b5e3-949aed261263 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:38.348648 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-88d45478-959f-40ec-b5e3-949aed261263 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:38.353554 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=44 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:38.367834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88d45478-959f-40ec-b5e3-949aed261263 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:38.368535 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88d45478-959f-40ec-b5e3-949aed261263 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:38.369075 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88d45478-959f-40ec-b5e3-949aed261263 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:38.369897 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88d45478-959f-40ec-b5e3-949aed261263 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:38.370473 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88d45478-959f-40ec-b5e3-949aed261263 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:38.371270 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88d45478-959f-40ec-b5e3-949aed261263 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:38.528543 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-88d45478-959f-40ec-b5e3-949aed261263 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:38.538482 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-88d45478-959f-40ec-b5e3-949aed261263 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.195350 Aug 24 16:50:38.552537 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 181/365] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:38 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:39.570362 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a04979db-f00b-467b-aa97-90a3ae5364b1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:39.571510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a04979db-f00b-467b-aa97-90a3ae5364b1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:39.579895 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a04979db-f00b-467b-aa97-90a3ae5364b1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:39.581342 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a04979db-f00b-467b-aa97-90a3ae5364b1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:39.582047 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a04979db-f00b-467b-aa97-90a3ae5364b1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:39.583360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a04979db-f00b-467b-aa97-90a3ae5364b1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:39.584140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a04979db-f00b-467b-aa97-90a3ae5364b1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:39.585029 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a04979db-f00b-467b-aa97-90a3ae5364b1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:39.750556 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a04979db-f00b-467b-aa97-90a3ae5364b1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:39.759203 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a04979db-f00b-467b-aa97-90a3ae5364b1 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.203868 Aug 24 16:50:39.760100 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 185/366] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:39 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:40.786120 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2a392388-6542-4118-b2f5-c737fd81e426 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:40.787328 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2a392388-6542-4118-b2f5-c737fd81e426 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:40.794031 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a392388-6542-4118-b2f5-c737fd81e426 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:40.794528 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a392388-6542-4118-b2f5-c737fd81e426 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:40.795141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a392388-6542-4118-b2f5-c737fd81e426 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:40.795901 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a392388-6542-4118-b2f5-c737fd81e426 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:40.796343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a392388-6542-4118-b2f5-c737fd81e426 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:40.796826 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a392388-6542-4118-b2f5-c737fd81e426 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:40.933096 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2a392388-6542-4118-b2f5-c737fd81e426 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:40.942841 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2a392388-6542-4118-b2f5-c737fd81e426 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.164206 Aug 24 16:50:40.954585 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 182/367] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:40 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:41.965897 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9e3af37b-a745-410a-918c-1111e95c56c0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:41.967252 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9e3af37b-a745-410a-918c-1111e95c56c0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:41.974579 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e3af37b-a745-410a-918c-1111e95c56c0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:41.975305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e3af37b-a745-410a-918c-1111e95c56c0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:41.975536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e3af37b-a745-410a-918c-1111e95c56c0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:41.976292 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e3af37b-a745-410a-918c-1111e95c56c0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:41.977366 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e3af37b-a745-410a-918c-1111e95c56c0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:41.977366 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e3af37b-a745-410a-918c-1111e95c56c0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:42.107174 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9e3af37b-a745-410a-918c-1111e95c56c0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:42.116440 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9e3af37b-a745-410a-918c-1111e95c56c0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.154545 Aug 24 16:50:42.116440 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 186/368] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:41 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:43.145588 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ccecd0fe-20b8-4fe8-b531-f899b1351765 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:43.148634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ccecd0fe-20b8-4fe8-b531-f899b1351765 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:43.161430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccecd0fe-20b8-4fe8-b531-f899b1351765 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:43.162103 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccecd0fe-20b8-4fe8-b531-f899b1351765 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:43.162799 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccecd0fe-20b8-4fe8-b531-f899b1351765 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:43.164111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccecd0fe-20b8-4fe8-b531-f899b1351765 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:43.165037 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccecd0fe-20b8-4fe8-b531-f899b1351765 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:43.165627 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccecd0fe-20b8-4fe8-b531-f899b1351765 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:43.423213 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ccecd0fe-20b8-4fe8-b531-f899b1351765 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:43.432745 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ccecd0fe-20b8-4fe8-b531-f899b1351765 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.297920 Aug 24 16:50:43.433321 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 183/369] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:43 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:44.455486 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1aa75fc1-558a-4c25-bde4-42f56588cc8c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:44.455486 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1aa75fc1-558a-4c25-bde4-42f56588cc8c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:44.483082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1aa75fc1-558a-4c25-bde4-42f56588cc8c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:44.483639 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1aa75fc1-558a-4c25-bde4-42f56588cc8c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:44.484653 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1aa75fc1-558a-4c25-bde4-42f56588cc8c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:44.485395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1aa75fc1-558a-4c25-bde4-42f56588cc8c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:44.485860 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1aa75fc1-558a-4c25-bde4-42f56588cc8c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:44.486293 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1aa75fc1-558a-4c25-bde4-42f56588cc8c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:44.683845 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1aa75fc1-558a-4c25-bde4-42f56588cc8c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:44.696999 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1aa75fc1-558a-4c25-bde4-42f56588cc8c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.245955 Aug 24 16:50:44.705271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 187/370] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:44 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:45.726178 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0df397bc-233d-45d2-b894-46bad9ab27d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:45.729806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0df397bc-233d-45d2-b894-46bad9ab27d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:45.748517 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0df397bc-233d-45d2-b894-46bad9ab27d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:45.754692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0df397bc-233d-45d2-b894-46bad9ab27d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:45.754692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0df397bc-233d-45d2-b894-46bad9ab27d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:45.754692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0df397bc-233d-45d2-b894-46bad9ab27d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:45.754692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0df397bc-233d-45d2-b894-46bad9ab27d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:45.755220 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0df397bc-233d-45d2-b894-46bad9ab27d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:45.934402 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0df397bc-233d-45d2-b894-46bad9ab27d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:45.945818 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0df397bc-233d-45d2-b894-46bad9ab27d7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.228796 Aug 24 16:50:45.948037 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 184/371] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:45 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:46.973014 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bfa6f32a-ef6e-457a-ac80-945addb3388f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:46.973565 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bfa6f32a-ef6e-457a-ac80-945addb3388f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:46.980989 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bfa6f32a-ef6e-457a-ac80-945addb3388f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:46.981739 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bfa6f32a-ef6e-457a-ac80-945addb3388f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:46.985667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bfa6f32a-ef6e-457a-ac80-945addb3388f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:46.985667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bfa6f32a-ef6e-457a-ac80-945addb3388f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:46.985667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bfa6f32a-ef6e-457a-ac80-945addb3388f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:46.985667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bfa6f32a-ef6e-457a-ac80-945addb3388f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:47.215772 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bfa6f32a-ef6e-457a-ac80-945addb3388f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:47.225669 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bfa6f32a-ef6e-457a-ac80-945addb3388f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.257100 Aug 24 16:50:47.226508 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 188/372] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:46 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:48.247486 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-94580632-0427-4872-90a1-4a5254ad9e06 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:48.249317 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-94580632-0427-4872-90a1-4a5254ad9e06 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:48.258071 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-94580632-0427-4872-90a1-4a5254ad9e06 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:48.259207 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-94580632-0427-4872-90a1-4a5254ad9e06 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:48.259653 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-94580632-0427-4872-90a1-4a5254ad9e06 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:48.267796 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-94580632-0427-4872-90a1-4a5254ad9e06 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:48.267796 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-94580632-0427-4872-90a1-4a5254ad9e06 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:48.267796 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-94580632-0427-4872-90a1-4a5254ad9e06 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:48.267796 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:48.448978 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-94580632-0427-4872-90a1-4a5254ad9e06 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:48.458019 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-94580632-0427-4872-90a1-4a5254ad9e06 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.214729 Aug 24 16:50:48.473263 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 185/373] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:48 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:49.479554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-89bbe4fa-5b3a-4e02-8531-f1b93e7cf33e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:49.480260 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-89bbe4fa-5b3a-4e02-8531-f1b93e7cf33e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:49.486966 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89bbe4fa-5b3a-4e02-8531-f1b93e7cf33e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:49.487713 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89bbe4fa-5b3a-4e02-8531-f1b93e7cf33e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:49.488334 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89bbe4fa-5b3a-4e02-8531-f1b93e7cf33e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:49.489108 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89bbe4fa-5b3a-4e02-8531-f1b93e7cf33e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:49.489739 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89bbe4fa-5b3a-4e02-8531-f1b93e7cf33e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:49.490502 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89bbe4fa-5b3a-4e02-8531-f1b93e7cf33e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:49.652994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-89bbe4fa-5b3a-4e02-8531-f1b93e7cf33e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:49.661415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-89bbe4fa-5b3a-4e02-8531-f1b93e7cf33e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.186170 Aug 24 16:50:49.662496 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 189/374] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:49 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:50.683242 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-68c781e6-86df-4d51-b251-de4bc84da1cc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:50.683802 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-68c781e6-86df-4d51-b251-de4bc84da1cc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:50.691804 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-68c781e6-86df-4d51-b251-de4bc84da1cc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:50.692290 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-68c781e6-86df-4d51-b251-de4bc84da1cc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:50.692758 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-68c781e6-86df-4d51-b251-de4bc84da1cc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:50.693437 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-68c781e6-86df-4d51-b251-de4bc84da1cc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:50.693885 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-68c781e6-86df-4d51-b251-de4bc84da1cc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:50.694303 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-68c781e6-86df-4d51-b251-de4bc84da1cc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:50.830824 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-68c781e6-86df-4d51-b251-de4bc84da1cc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:50.838696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-68c781e6-86df-4d51-b251-de4bc84da1cc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1500 microversion: 2.1 time: 0.159638 Aug 24 16:50:50.839252 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 186/375] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:50 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1500 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:50.859230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-307f4032-f978-43b6-bc10-92252bb2ac75 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bd070d6-c626-443d-853a-8034057e49fe"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:50.861823 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-307f4032-f978-43b6-bc10-92252bb2ac75 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:50.867819 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-307f4032-f978-43b6-bc10-92252bb2ac75 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:50.868298 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-307f4032-f978-43b6-bc10-92252bb2ac75 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:50.868773 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-307f4032-f978-43b6-bc10-92252bb2ac75 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:50.869520 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-307f4032-f978-43b6-bc10-92252bb2ac75 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:50.870025 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-307f4032-f978-43b6-bc10-92252bb2ac75 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:50.870395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-307f4032-f978-43b6-bc10-92252bb2ac75 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:50.896172 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-307f4032-f978-43b6-bc10-92252bb2ac75 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] HTTP exception thrown: Cannot 'attach_volume' instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b while it is in vm_state rescued Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-307f4032-f978-43b6-bc10-92252bb2ac75 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Request method failure captured: Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: POST /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b/os-volume_attachments HTTP/1.1 Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 74 Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZISQVjDYN-eIogkcFZs4LwnKoC8sLc9FZzdslGTzUrTNQWcUS4KZag3pL6aq7dRyIc2KFLdQFiK-4WL410C3YKTO4TmPCffofqSVR3WjOCdAkm3OD1T4kuqoqivwNCWFfuz5cdlLKVbaudAbBuC_4ZmqoIRB4h0CNWV89o1uMxmgw Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 42f5635b43e74a96a56d56cccbc111b5 Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:50:50.899406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:50:50.901158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:50:50.901158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:50:50.901158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 42f5635b43e74a96a56d56cccbc111b5 Aug 24 16:50:50.901158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:50:50.901158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-ServerRescueNegativeTestJSON-175432080-project Aug 24 16:50:50.901158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:50:50.901158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:50:50.901158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 45913fc3d9ba42ea9e971db25e656c61 Aug 24 16:50:50.901158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-175432080-project Aug 24 16:50:50.901158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Aug 24 16:50:50.901158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {"volumeAttachment": {"volumeId": "9bd070d6-c626-443d-853a-8034057e49fe"}} Aug 24 16:50:50.901158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Cannot 'attach_volume' instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b while it is in vm_state rescued Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'server_id': 'dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b', 'body': {'volumeAttachment': {'volumeId': '9bd070d6-c626-443d-853a-8034057e49fe'}}} Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:50.902537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b while it is in vm_state rescued Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:50.903789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:50.905536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:50.905536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:50.905536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b while it is in vm_state rescued Aug 24 16:50:50.905536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:50:50.905536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-307f4032-f978-43b6-bc10-92252bb2ac75 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Returning 409 to user: Cannot 'attach_volume' instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b while it is in vm_state rescued {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:50.905536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-307f4032-f978-43b6-bc10-92252bb2ac75 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "POST /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044646 Aug 24 16:50:50.905536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 190/376] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 16:50:50 2022] POST /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 16:50:50.909016 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ab109008-6e51-4a4f-8159-91aa8269ead6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:50.909540 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ab109008-6e51-4a4f-8159-91aa8269ead6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:50.915791 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab109008-6e51-4a4f-8159-91aa8269ead6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:50.916283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab109008-6e51-4a4f-8159-91aa8269ead6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:50.916817 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab109008-6e51-4a4f-8159-91aa8269ead6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:50.917542 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab109008-6e51-4a4f-8159-91aa8269ead6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:50.918002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab109008-6e51-4a4f-8159-91aa8269ead6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:50.918432 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab109008-6e51-4a4f-8159-91aa8269ead6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:51.115844 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ab109008-6e51-4a4f-8159-91aa8269ead6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "POST /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b/action" status: 202 len: 0 microversion: 2.1 time: 0.210502 Aug 24 16:50:51.116497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 187/377] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 16:50:50 2022] POST /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:50:51.127713 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4a67530f-a922-4fbf-a30b-c3b3f0ad1432 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:51.128442 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4a67530f-a922-4fbf-a30b-c3b3f0ad1432 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:51.134802 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a67530f-a922-4fbf-a30b-c3b3f0ad1432 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:51.135283 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a67530f-a922-4fbf-a30b-c3b3f0ad1432 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:51.135752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a67530f-a922-4fbf-a30b-c3b3f0ad1432 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:51.136477 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a67530f-a922-4fbf-a30b-c3b3f0ad1432 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:51.136938 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a67530f-a922-4fbf-a30b-c3b3f0ad1432 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:51.137366 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a67530f-a922-4fbf-a30b-c3b3f0ad1432 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:51.278690 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4a67530f-a922-4fbf-a30b-c3b3f0ad1432 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:51.286452 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4a67530f-a922-4fbf-a30b-c3b3f0ad1432 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1508 microversion: 2.1 time: 0.163214 Aug 24 16:50:51.287013 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 191/378] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:51 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:52.310954 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b45595e2-16a5-48fa-95a8-ccf670237da2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:52.310954 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b45595e2-16a5-48fa-95a8-ccf670237da2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:52.316667 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b45595e2-16a5-48fa-95a8-ccf670237da2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:52.317153 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b45595e2-16a5-48fa-95a8-ccf670237da2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:52.317590 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b45595e2-16a5-48fa-95a8-ccf670237da2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:52.318285 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b45595e2-16a5-48fa-95a8-ccf670237da2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:52.318758 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b45595e2-16a5-48fa-95a8-ccf670237da2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:52.319211 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b45595e2-16a5-48fa-95a8-ccf670237da2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:52.460121 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b45595e2-16a5-48fa-95a8-ccf670237da2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:52.465774 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b45595e2-16a5-48fa-95a8-ccf670237da2 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1508 microversion: 2.1 time: 0.161093 Aug 24 16:50:52.466339 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 188/379] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:52 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:53.486929 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dfeee525-1814-489e-b2ec-83bd87ba09f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:53.487703 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dfeee525-1814-489e-b2ec-83bd87ba09f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:53.493818 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfeee525-1814-489e-b2ec-83bd87ba09f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:53.494360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfeee525-1814-489e-b2ec-83bd87ba09f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:53.494795 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfeee525-1814-489e-b2ec-83bd87ba09f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:53.495524 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfeee525-1814-489e-b2ec-83bd87ba09f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:53.496007 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfeee525-1814-489e-b2ec-83bd87ba09f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:53.496722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfeee525-1814-489e-b2ec-83bd87ba09f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:53.625963 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-dfeee525-1814-489e-b2ec-83bd87ba09f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:53.633769 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dfeee525-1814-489e-b2ec-83bd87ba09f0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1508 microversion: 2.1 time: 0.150541 Aug 24 16:50:53.634299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 192/380] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:53 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:54.655064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-90bf24e4-26fa-4a66-94b0-a12352acb632 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:54.655674 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-90bf24e4-26fa-4a66-94b0-a12352acb632 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:54.662573 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-90bf24e4-26fa-4a66-94b0-a12352acb632 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:54.663060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-90bf24e4-26fa-4a66-94b0-a12352acb632 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:54.663497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-90bf24e4-26fa-4a66-94b0-a12352acb632 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:54.664188 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-90bf24e4-26fa-4a66-94b0-a12352acb632 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:54.664671 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-90bf24e4-26fa-4a66-94b0-a12352acb632 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:54.665101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-90bf24e4-26fa-4a66-94b0-a12352acb632 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:54.794121 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-90bf24e4-26fa-4a66-94b0-a12352acb632 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:54.801736 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-90bf24e4-26fa-4a66-94b0-a12352acb632 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1508 microversion: 2.1 time: 0.150528 Aug 24 16:50:54.802285 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 189/381] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:54 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:55.822420 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c748b143-8582-4099-9c04-a117ddea456c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:55.822962 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c748b143-8582-4099-9c04-a117ddea456c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:55.829482 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c748b143-8582-4099-9c04-a117ddea456c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:55.829953 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c748b143-8582-4099-9c04-a117ddea456c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:55.830381 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c748b143-8582-4099-9c04-a117ddea456c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:55.831053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c748b143-8582-4099-9c04-a117ddea456c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:55.831499 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c748b143-8582-4099-9c04-a117ddea456c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:55.831914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c748b143-8582-4099-9c04-a117ddea456c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:55.956149 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c748b143-8582-4099-9c04-a117ddea456c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:55.963752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c748b143-8582-4099-9c04-a117ddea456c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1508 microversion: 2.1 time: 0.145211 Aug 24 16:50:55.964319 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 193/382] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:55 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:56.985565 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e0fe821a-3fed-4f81-8545-cb366487966f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:56.986177 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e0fe821a-3fed-4f81-8545-cb366487966f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:56.992554 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0fe821a-3fed-4f81-8545-cb366487966f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:56.993037 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0fe821a-3fed-4f81-8545-cb366487966f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:56.993472 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0fe821a-3fed-4f81-8545-cb366487966f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:56.994158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0fe821a-3fed-4f81-8545-cb366487966f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:56.994613 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0fe821a-3fed-4f81-8545-cb366487966f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:56.995039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0fe821a-3fed-4f81-8545-cb366487966f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:57.127758 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e0fe821a-3fed-4f81-8545-cb366487966f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:57.135285 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e0fe821a-3fed-4f81-8545-cb366487966f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1508 microversion: 2.1 time: 0.154190 Aug 24 16:50:57.135846 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 190/383] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:56 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:58.156270 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-76a964bd-bd55-4439-9e6d-13833e4b8925 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:58.156916 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-76a964bd-bd55-4439-9e6d-13833e4b8925 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:58.158746 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=28 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:58.163327 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a964bd-bd55-4439-9e6d-13833e4b8925 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:58.163802 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a964bd-bd55-4439-9e6d-13833e4b8925 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:58.164236 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a964bd-bd55-4439-9e6d-13833e4b8925 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:58.164947 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a964bd-bd55-4439-9e6d-13833e4b8925 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:58.165399 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a964bd-bd55-4439-9e6d-13833e4b8925 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:58.165818 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a964bd-bd55-4439-9e6d-13833e4b8925 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:58.168326 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=96 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:58.294152 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-76a964bd-bd55-4439-9e6d-13833e4b8925 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:58.302475 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-76a964bd-bd55-4439-9e6d-13833e4b8925 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1508 microversion: 2.1 time: 0.150043 Aug 24 16:50:58.303081 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 194/384] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:58 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:59.324034 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b9c95965-7b51-4765-a81d-c669eda87b17 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:59.324822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b9c95965-7b51-4765-a81d-c669eda87b17 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:59.332136 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b9c95965-7b51-4765-a81d-c669eda87b17 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:59.332742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b9c95965-7b51-4765-a81d-c669eda87b17 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:59.333370 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b9c95965-7b51-4765-a81d-c669eda87b17 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:59.334129 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b9c95965-7b51-4765-a81d-c669eda87b17 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:59.334646 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b9c95965-7b51-4765-a81d-c669eda87b17 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:59.335156 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b9c95965-7b51-4765-a81d-c669eda87b17 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:59.487532 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b9c95965-7b51-4765-a81d-c669eda87b17 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:59.495763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b9c95965-7b51-4765-a81d-c669eda87b17 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1514 microversion: 2.1 time: 0.175501 Aug 24 16:50:59.496318 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 191/385] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:59 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:02.294910 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9dc0cb12-0b21-40af-ab85-c033cb49d2a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Action: 'create', calling method: .version_select at 0x7fa194e5f670>, body: {"keypair": {"name": "tempest-keypair-1486778919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtBdFHlSIsJryHCcHPO1w5jp0+jS3Ko8EnmjO7xEM8sTBmWwHpypukNw797GEoZcpkUDA3GjmuWIYJInH/62C/mGTJ9RXGfqsVp85oocyI9/Y2brnfuMraJIaHAFaSsAg=="}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:02.307952 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-9dc0cb12-0b21-40af-ab85-c033cb49d2a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Getting quotas for project 42f5635b43e74a96a56d56cccbc111b5. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:51:02.312120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-9dc0cb12-0b21-40af-ab85-c033cb49d2a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Getting quotas for user 45913fc3d9ba42ea9e971db25e656c61 and project 42f5635b43e74a96a56d56cccbc111b5. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:51:02.405674 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9dc0cb12-0b21-40af-ab85-c033cb49d2a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117265 Aug 24 16:51:02.406281 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 195/386] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Aug 24 16:51:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:05.070761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-534099758", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce570f83-6f1d-44d5-bf3a-fed77a6a5242"}], "security_groups": [{"name": "tempest-securitygroup--971572440"}], "key_name": "tempest-keypair-1486778919", "user_data": "}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:05.177252 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.network.neutron [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] validate_networks() for [('ce570f83-6f1d-44d5-bf3a-fed77a6a5242', None, None, None, None, None)] {{(pid=127715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:51:05.568294 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Flavor limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:51:05.568778 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Image limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:51:05.569291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Flavor pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:51:05.569707 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Image pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:51:05.570148 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:51:05.579609 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:05.580091 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:05.580567 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:05.581299 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:05.581758 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:05.582185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:05.599312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Getting quotas for project 42f5635b43e74a96a56d56cccbc111b5. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:51:05.603417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Getting quotas for user 45913fc3d9ba42ea9e971db25e656c61 and project 42f5635b43e74a96a56d56cccbc111b5. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:51:05.614351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Going to run 1 instances... {{(pid=127715) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:51:05.616661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:51:06.143627 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9feb6b50-3c91-4f51-8e15-7bf618159ed5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.078216 Aug 24 16:51:06.145049 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 192/387] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:51:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:51:06.156226 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-20100c11-7b12-482d-ad41-ef1c3e614663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:06.157717 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-20100c11-7b12-482d-ad41-ef1c3e614663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:06.220194 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-20100c11-7b12-482d-ad41-ef1c3e614663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:06.227743 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-20100c11-7b12-482d-ad41-ef1c3e614663 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1245 microversion: 2.1 time: 0.075516 Aug 24 16:51:06.228395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 196/388] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:06 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1245 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:07.249114 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c23429d9-3cdb-4cfe-af8a-b0f2bdd410b0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:07.249765 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c23429d9-3cdb-4cfe-af8a-b0f2bdd410b0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:07.259914 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c23429d9-3cdb-4cfe-af8a-b0f2bdd410b0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:07.259914 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c23429d9-3cdb-4cfe-af8a-b0f2bdd410b0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:07.260375 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c23429d9-3cdb-4cfe-af8a-b0f2bdd410b0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:07.260839 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c23429d9-3cdb-4cfe-af8a-b0f2bdd410b0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:07.261298 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c23429d9-3cdb-4cfe-af8a-b0f2bdd410b0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:07.261727 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c23429d9-3cdb-4cfe-af8a-b0f2bdd410b0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:07.321613 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c23429d9-3cdb-4cfe-af8a-b0f2bdd410b0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:07.329642 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c23429d9-3cdb-4cfe-af8a-b0f2bdd410b0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1249 microversion: 2.1 time: 0.085391 Aug 24 16:51:07.330208 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 193/389] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:07 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:08.350948 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-20dae294-4f3e-4acf-b16d-0f9006b1d54e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:08.351725 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-20dae294-4f3e-4acf-b16d-0f9006b1d54e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:08.353567 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=5 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:08.359018 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20dae294-4f3e-4acf-b16d-0f9006b1d54e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:08.359496 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20dae294-4f3e-4acf-b16d-0f9006b1d54e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:08.359928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20dae294-4f3e-4acf-b16d-0f9006b1d54e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:08.360731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20dae294-4f3e-4acf-b16d-0f9006b1d54e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:08.365139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20dae294-4f3e-4acf-b16d-0f9006b1d54e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:08.365139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20dae294-4f3e-4acf-b16d-0f9006b1d54e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:08.426078 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-20dae294-4f3e-4acf-b16d-0f9006b1d54e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:08.435230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-20dae294-4f3e-4acf-b16d-0f9006b1d54e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1297 microversion: 2.1 time: 0.088459 Aug 24 16:51:08.435812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 197/390] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:08 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:09.456490 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d2265172-7156-4bd2-ad8b-10271a891b42 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:09.457138 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d2265172-7156-4bd2-ad8b-10271a891b42 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:09.459636 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:09.464369 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2265172-7156-4bd2-ad8b-10271a891b42 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:09.467984 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2265172-7156-4bd2-ad8b-10271a891b42 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:09.467984 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2265172-7156-4bd2-ad8b-10271a891b42 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:09.467984 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2265172-7156-4bd2-ad8b-10271a891b42 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:09.467984 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2265172-7156-4bd2-ad8b-10271a891b42 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:09.468460 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2265172-7156-4bd2-ad8b-10271a891b42 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:09.742261 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d2265172-7156-4bd2-ad8b-10271a891b42 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:09.750152 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d2265172-7156-4bd2-ad8b-10271a891b42 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1297 microversion: 2.1 time: 0.297539 Aug 24 16:51:09.750714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 194/391] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:09 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1297 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:10.770854 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-25ffb1fe-df72-4486-b02f-906eabe51206 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:10.771496 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-25ffb1fe-df72-4486-b02f-906eabe51206 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:10.777712 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25ffb1fe-df72-4486-b02f-906eabe51206 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:10.778193 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25ffb1fe-df72-4486-b02f-906eabe51206 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:10.778621 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25ffb1fe-df72-4486-b02f-906eabe51206 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:10.779309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25ffb1fe-df72-4486-b02f-906eabe51206 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:10.779756 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25ffb1fe-df72-4486-b02f-906eabe51206 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:10.780171 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25ffb1fe-df72-4486-b02f-906eabe51206 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:10.848498 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-25ffb1fe-df72-4486-b02f-906eabe51206 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:10.856202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-25ffb1fe-df72-4486-b02f-906eabe51206 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1297 microversion: 2.1 time: 0.089277 Aug 24 16:51:10.860956 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 198/392] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:10 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:11.876459 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f817ebef-213f-4956-a743-cd50b152f3a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:11.877102 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f817ebef-213f-4956-a743-cd50b152f3a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:11.884089 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f817ebef-213f-4956-a743-cd50b152f3a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:11.884604 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f817ebef-213f-4956-a743-cd50b152f3a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:11.885038 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f817ebef-213f-4956-a743-cd50b152f3a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:11.885717 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f817ebef-213f-4956-a743-cd50b152f3a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:11.886170 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f817ebef-213f-4956-a743-cd50b152f3a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:11.886591 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f817ebef-213f-4956-a743-cd50b152f3a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:11.946446 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f817ebef-213f-4956-a743-cd50b152f3a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:11.954000 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f817ebef-213f-4956-a743-cd50b152f3a8 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1297 microversion: 2.1 time: 0.081632 Aug 24 16:51:11.954681 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 195/393] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:11 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:12.974673 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3bba8603-4dfe-44bd-9b2a-fc93f574cc50 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:12.975284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3bba8603-4dfe-44bd-9b2a-fc93f574cc50 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:12.981446 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3bba8603-4dfe-44bd-9b2a-fc93f574cc50 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:12.981923 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3bba8603-4dfe-44bd-9b2a-fc93f574cc50 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:12.982351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3bba8603-4dfe-44bd-9b2a-fc93f574cc50 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:12.983058 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3bba8603-4dfe-44bd-9b2a-fc93f574cc50 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:12.983498 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3bba8603-4dfe-44bd-9b2a-fc93f574cc50 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:12.983913 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3bba8603-4dfe-44bd-9b2a-fc93f574cc50 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:13.046396 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3bba8603-4dfe-44bd-9b2a-fc93f574cc50 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:13.054891 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3bba8603-4dfe-44bd-9b2a-fc93f574cc50 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1297 microversion: 2.1 time: 0.083944 Aug 24 16:51:13.055681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 199/394] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:12 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:14.075525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7731b085-ec7a-4760-af24-41ffee69eac7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:14.076040 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7731b085-ec7a-4760-af24-41ffee69eac7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:14.082617 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7731b085-ec7a-4760-af24-41ffee69eac7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:14.083099 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7731b085-ec7a-4760-af24-41ffee69eac7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:14.083535 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7731b085-ec7a-4760-af24-41ffee69eac7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:14.084857 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7731b085-ec7a-4760-af24-41ffee69eac7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:14.085316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7731b085-ec7a-4760-af24-41ffee69eac7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:14.085743 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7731b085-ec7a-4760-af24-41ffee69eac7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:14.148569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7731b085-ec7a-4760-af24-41ffee69eac7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:14.156155 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7731b085-ec7a-4760-af24-41ffee69eac7 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1297 microversion: 2.1 time: 0.084572 Aug 24 16:51:14.156741 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 196/395] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:14 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:15.178055 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4912ce46-8427-487c-b622-9404195a094f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:15.178597 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4912ce46-8427-487c-b622-9404195a094f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:15.184589 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4912ce46-8427-487c-b622-9404195a094f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:15.185074 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4912ce46-8427-487c-b622-9404195a094f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:15.185513 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4912ce46-8427-487c-b622-9404195a094f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:15.186207 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4912ce46-8427-487c-b622-9404195a094f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:15.186662 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4912ce46-8427-487c-b622-9404195a094f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:15.187086 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4912ce46-8427-487c-b622-9404195a094f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:15.249164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4912ce46-8427-487c-b622-9404195a094f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:15.257577 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4912ce46-8427-487c-b622-9404195a094f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1297 microversion: 2.1 time: 0.083889 Aug 24 16:51:15.258150 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 200/396] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:15 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:16.287785 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ee866588-8b63-427c-9aec-e0da3f327d7b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:16.287785 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ee866588-8b63-427c-9aec-e0da3f327d7b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:16.289400 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:16.290058 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=6 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:16.292193 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee866588-8b63-427c-9aec-e0da3f327d7b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:16.293553 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee866588-8b63-427c-9aec-e0da3f327d7b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:16.293553 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee866588-8b63-427c-9aec-e0da3f327d7b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:16.294173 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee866588-8b63-427c-9aec-e0da3f327d7b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:16.294778 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee866588-8b63-427c-9aec-e0da3f327d7b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:16.295509 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee866588-8b63-427c-9aec-e0da3f327d7b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:16.363035 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ee866588-8b63-427c-9aec-e0da3f327d7b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:16.371591 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ee866588-8b63-427c-9aec-e0da3f327d7b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1303 microversion: 2.1 time: 0.092344 Aug 24 16:51:16.372687 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 197/397] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:16 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:17.392585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-26ca23bb-6335-4c92-91c1-2cacbc619f6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:17.393264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-26ca23bb-6335-4c92-91c1-2cacbc619f6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:17.395155 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=6 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:17.403812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26ca23bb-6335-4c92-91c1-2cacbc619f6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:17.403812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26ca23bb-6335-4c92-91c1-2cacbc619f6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:17.403812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26ca23bb-6335-4c92-91c1-2cacbc619f6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:17.403812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26ca23bb-6335-4c92-91c1-2cacbc619f6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:17.404156 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26ca23bb-6335-4c92-91c1-2cacbc619f6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:17.404156 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26ca23bb-6335-4c92-91c1-2cacbc619f6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:17.475792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-4382f930-8473-4541-8656-cf8164b323ef req-8357ef49-69f5-43c4-9d6d-4bab88fc29a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ecc526-a083-4f47-ac70-0b06d5b66158", "tag": "4cb866ee-2954-4fbb-953c-0cde1c4ca053"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:17.492844 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-4382f930-8473-4541-8656-cf8164b323ef req-8357ef49-69f5-43c4-9d6d-4bab88fc29a9 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:17.493053 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-4382f930-8473-4541-8656-cf8164b323ef req-8357ef49-69f5-43c4-9d6d-4bab88fc29a9 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:17.493636 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-4382f930-8473-4541-8656-cf8164b323ef req-8357ef49-69f5-43c4-9d6d-4bab88fc29a9 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:17.509646 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-4382f930-8473-4541-8656-cf8164b323ef req-8357ef49-69f5-43c4-9d6d-4bab88fc29a9 service nova] Creating event network-changed:4cb866ee-2954-4fbb-953c-0cde1c4ca053 for instance 84ecc526-a083-4f47-ac70-0b06d5b66158 on hv-cinder-85220 Aug 24 16:51:17.514823 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-4382f930-8473-4541-8656-cf8164b323ef req-8357ef49-69f5-43c4-9d6d-4bab88fc29a9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043681 Aug 24 16:51:17.515549 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 198/398] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:51:17.551069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-26ca23bb-6335-4c92-91c1-2cacbc619f6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:17.559158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-26ca23bb-6335-4c92-91c1-2cacbc619f6f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1370 microversion: 2.1 time: 0.170590 Aug 24 16:51:17.567362 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 201/399] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:17 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:18.581506 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-56a94195-7fce-48b5-9382-e03102f82be0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:18.582208 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-56a94195-7fce-48b5-9382-e03102f82be0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:18.589237 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-56a94195-7fce-48b5-9382-e03102f82be0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:18.589722 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-56a94195-7fce-48b5-9382-e03102f82be0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:18.590161 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-56a94195-7fce-48b5-9382-e03102f82be0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:18.590857 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-56a94195-7fce-48b5-9382-e03102f82be0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:18.591305 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-56a94195-7fce-48b5-9382-e03102f82be0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:18.591726 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-56a94195-7fce-48b5-9382-e03102f82be0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:18.720045 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-56a94195-7fce-48b5-9382-e03102f82be0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:18.727708 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-56a94195-7fce-48b5-9382-e03102f82be0 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1370 microversion: 2.1 time: 0.151052 Aug 24 16:51:18.728326 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 199/400] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:18 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:19.750311 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e5652460-714b-4829-a616-f888bea70dea tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:19.750834 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e5652460-714b-4829-a616-f888bea70dea tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:19.757863 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5652460-714b-4829-a616-f888bea70dea tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:19.758447 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5652460-714b-4829-a616-f888bea70dea tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:19.758882 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5652460-714b-4829-a616-f888bea70dea tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:19.759904 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5652460-714b-4829-a616-f888bea70dea tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:19.760000 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5652460-714b-4829-a616-f888bea70dea tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:19.760441 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5652460-714b-4829-a616-f888bea70dea tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:19.889315 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e5652460-714b-4829-a616-f888bea70dea tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:19.897866 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e5652460-714b-4829-a616-f888bea70dea tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1370 microversion: 2.1 time: 0.151820 Aug 24 16:51:19.898534 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 202/401] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:19 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:20.918903 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4219d80c-79e0-4e19-9e8f-e8ff4cb51815 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:20.919558 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4219d80c-79e0-4e19-9e8f-e8ff4cb51815 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:20.925888 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4219d80c-79e0-4e19-9e8f-e8ff4cb51815 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:20.926379 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4219d80c-79e0-4e19-9e8f-e8ff4cb51815 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:20.926818 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4219d80c-79e0-4e19-9e8f-e8ff4cb51815 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:20.927582 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4219d80c-79e0-4e19-9e8f-e8ff4cb51815 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:20.928044 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4219d80c-79e0-4e19-9e8f-e8ff4cb51815 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:20.928630 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4219d80c-79e0-4e19-9e8f-e8ff4cb51815 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:20.933705 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:21.073103 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4219d80c-79e0-4e19-9e8f-e8ff4cb51815 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:21.073103 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4219d80c-79e0-4e19-9e8f-e8ff4cb51815 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1370 microversion: 2.1 time: 0.154634 Aug 24 16:51:21.073103 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 200/402] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:20 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:22.090226 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-915807d8-5326-41be-8591-2f3aab4d3c9c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:22.093127 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-915807d8-5326-41be-8591-2f3aab4d3c9c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:22.097041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-915807d8-5326-41be-8591-2f3aab4d3c9c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:22.097521 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-915807d8-5326-41be-8591-2f3aab4d3c9c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:22.097957 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-915807d8-5326-41be-8591-2f3aab4d3c9c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:22.098645 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-915807d8-5326-41be-8591-2f3aab4d3c9c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:22.099141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-915807d8-5326-41be-8591-2f3aab4d3c9c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:22.100081 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-915807d8-5326-41be-8591-2f3aab4d3c9c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:22.249093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-915807d8-5326-41be-8591-2f3aab4d3c9c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:22.256953 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-915807d8-5326-41be-8591-2f3aab4d3c9c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1370 microversion: 2.1 time: 0.170928 Aug 24 16:51:22.257523 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 203/403] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:22 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:23.277153 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-891ad1af-092e-4dd2-b16d-1db8547f9a7c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:23.277808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-891ad1af-092e-4dd2-b16d-1db8547f9a7c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:23.284509 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-891ad1af-092e-4dd2-b16d-1db8547f9a7c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:23.285001 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-891ad1af-092e-4dd2-b16d-1db8547f9a7c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:23.285441 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-891ad1af-092e-4dd2-b16d-1db8547f9a7c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:23.286127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-891ad1af-092e-4dd2-b16d-1db8547f9a7c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:23.286580 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-891ad1af-092e-4dd2-b16d-1db8547f9a7c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:23.287308 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-891ad1af-092e-4dd2-b16d-1db8547f9a7c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:23.429729 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-891ad1af-092e-4dd2-b16d-1db8547f9a7c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:23.437434 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-891ad1af-092e-4dd2-b16d-1db8547f9a7c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1370 microversion: 2.1 time: 0.164476 Aug 24 16:51:23.438006 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 201/404] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:23 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:24.459427 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8670b45c-f5b8-42ac-bd38-ad44bb931156 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:24.460110 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8670b45c-f5b8-42ac-bd38-ad44bb931156 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:24.466579 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8670b45c-f5b8-42ac-bd38-ad44bb931156 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:24.467070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8670b45c-f5b8-42ac-bd38-ad44bb931156 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:24.467508 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8670b45c-f5b8-42ac-bd38-ad44bb931156 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:24.468203 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8670b45c-f5b8-42ac-bd38-ad44bb931156 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:24.468700 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8670b45c-f5b8-42ac-bd38-ad44bb931156 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:24.469127 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8670b45c-f5b8-42ac-bd38-ad44bb931156 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:24.746408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8670b45c-f5b8-42ac-bd38-ad44bb931156 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:24.755212 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8670b45c-f5b8-42ac-bd38-ad44bb931156 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1370 microversion: 2.1 time: 0.300180 Aug 24 16:51:24.756488 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 204/405] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:24 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1370 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:25.775941 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5256a500-5318-425d-a197-b809bdb455fc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:25.777284 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5256a500-5318-425d-a197-b809bdb455fc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:25.784186 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5256a500-5318-425d-a197-b809bdb455fc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:25.785557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5256a500-5318-425d-a197-b809bdb455fc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:25.786061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5256a500-5318-425d-a197-b809bdb455fc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:25.786838 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5256a500-5318-425d-a197-b809bdb455fc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:25.787956 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5256a500-5318-425d-a197-b809bdb455fc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:25.788511 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5256a500-5318-425d-a197-b809bdb455fc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:25.967734 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-5256a500-5318-425d-a197-b809bdb455fc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:25.976598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5256a500-5318-425d-a197-b809bdb455fc tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1370 microversion: 2.1 time: 0.204440 Aug 24 16:51:25.977177 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 202/406] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:25 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:26.455549 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-cc36c034-2e62-4a79-a042-7ecf648540bc req-b483bb57-abab-4ee7-8479-d2639fe172b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ecc526-a083-4f47-ac70-0b06d5b66158", "name": "network-vif-plugged", "status": "completed", "tag": "4cb866ee-2954-4fbb-953c-0cde1c4ca053"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:26.469567 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-cc36c034-2e62-4a79-a042-7ecf648540bc req-b483bb57-abab-4ee7-8479-d2639fe172b5 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:26.475829 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-cc36c034-2e62-4a79-a042-7ecf648540bc req-b483bb57-abab-4ee7-8479-d2639fe172b5 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:26.475829 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-cc36c034-2e62-4a79-a042-7ecf648540bc req-b483bb57-abab-4ee7-8479-d2639fe172b5 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:26.483949 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-cc36c034-2e62-4a79-a042-7ecf648540bc req-b483bb57-abab-4ee7-8479-d2639fe172b5 service nova] Creating event network-vif-plugged:4cb866ee-2954-4fbb-953c-0cde1c4ca053 for instance 84ecc526-a083-4f47-ac70-0b06d5b66158 on hv-cinder-85220 Aug 24 16:51:26.490049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-cc36c034-2e62-4a79-a042-7ecf648540bc req-b483bb57-abab-4ee7-8479-d2639fe172b5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038795 Aug 24 16:51:26.490998 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 205/407] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:26.997615 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7f1742f6-2bbd-411a-8764-8953484601ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:26.998726 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7f1742f6-2bbd-411a-8764-8953484601ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:27.005210 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7f1742f6-2bbd-411a-8764-8953484601ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:27.005593 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7f1742f6-2bbd-411a-8764-8953484601ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:27.006580 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7f1742f6-2bbd-411a-8764-8953484601ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:27.007277 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7f1742f6-2bbd-411a-8764-8953484601ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:27.008519 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7f1742f6-2bbd-411a-8764-8953484601ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:27.008960 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7f1742f6-2bbd-411a-8764-8953484601ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:27.217533 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7f1742f6-2bbd-411a-8764-8953484601ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:27.227573 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7f1742f6-2bbd-411a-8764-8953484601ff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1370 microversion: 2.1 time: 0.233804 Aug 24 16:51:27.236764 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 203/408] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:26 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:51:28.249690 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bd8be8fa-13b8-4d2b-8b92-c5678736deff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:28.250471 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bd8be8fa-13b8-4d2b-8b92-c5678736deff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:28.252921 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:28.258143 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd8be8fa-13b8-4d2b-8b92-c5678736deff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:28.258625 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd8be8fa-13b8-4d2b-8b92-c5678736deff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:28.259264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd8be8fa-13b8-4d2b-8b92-c5678736deff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:28.259963 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd8be8fa-13b8-4d2b-8b92-c5678736deff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:28.260422 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd8be8fa-13b8-4d2b-8b92-c5678736deff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:28.260879 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd8be8fa-13b8-4d2b-8b92-c5678736deff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:28.410550 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bd8be8fa-13b8-4d2b-8b92-c5678736deff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:28.422416 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bd8be8fa-13b8-4d2b-8b92-c5678736deff tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1370 microversion: 2.1 time: 0.173929 Aug 24 16:51:28.422416 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 206/409] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:28 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:28.715474 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:51:28.715667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Wed Aug 24 16:51:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:51:29.440282 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1a8a0d9f-9e17-4057-a343-1ea403c1df81 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:29.440938 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1a8a0d9f-9e17-4057-a343-1ea403c1df81 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:29.453422 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a8a0d9f-9e17-4057-a343-1ea403c1df81 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:29.453929 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a8a0d9f-9e17-4057-a343-1ea403c1df81 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:29.454374 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a8a0d9f-9e17-4057-a343-1ea403c1df81 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:29.455083 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a8a0d9f-9e17-4057-a343-1ea403c1df81 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:29.456834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a8a0d9f-9e17-4057-a343-1ea403c1df81 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:29.460012 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a8a0d9f-9e17-4057-a343-1ea403c1df81 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:29.632341 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1a8a0d9f-9e17-4057-a343-1ea403c1df81 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:29.641864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1a8a0d9f-9e17-4057-a343-1ea403c1df81 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1370 microversion: 2.1 time: 0.205250 Aug 24 16:51:29.643101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 204/410] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:29 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1370 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:30.663332 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-64d10215-924c-444c-a24f-8f78d69f0aef tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:30.663897 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-64d10215-924c-444c-a24f-8f78d69f0aef tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:30.670025 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64d10215-924c-444c-a24f-8f78d69f0aef tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:30.670506 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64d10215-924c-444c-a24f-8f78d69f0aef tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:30.670933 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64d10215-924c-444c-a24f-8f78d69f0aef tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:30.671650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64d10215-924c-444c-a24f-8f78d69f0aef tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:30.672095 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64d10215-924c-444c-a24f-8f78d69f0aef tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:30.672726 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64d10215-924c-444c-a24f-8f78d69f0aef tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:30.951111 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-64d10215-924c-444c-a24f-8f78d69f0aef tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:30.964146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-64d10215-924c-444c-a24f-8f78d69f0aef tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1565 microversion: 2.1 time: 0.304772 Aug 24 16:51:30.965252 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 207/411] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:30 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1565 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:30.992138 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6a8ce588-5c69-4613-af04-1d9386a60db5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:30.992776 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6a8ce588-5c69-4613-af04-1d9386a60db5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:31.000760 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a8ce588-5c69-4613-af04-1d9386a60db5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:31.002592 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a8ce588-5c69-4613-af04-1d9386a60db5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:31.004665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a8ce588-5c69-4613-af04-1d9386a60db5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:31.006878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a8ce588-5c69-4613-af04-1d9386a60db5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:31.007446 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a8ce588-5c69-4613-af04-1d9386a60db5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:31.009876 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a8ce588-5c69-4613-af04-1d9386a60db5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:31.123629 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6a8ce588-5c69-4613-af04-1d9386a60db5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136122 Aug 24 16:51:31.127569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 205/412] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Aug 24 16:51:30 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:32.278569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-ddad0d78-e9bc-492f-a67d-0139c9a954c1 req-713d63f1-2d1d-4f0b-a177-f43d1b36eaa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ecc526-a083-4f47-ac70-0b06d5b66158", "tag": "4cb866ee-2954-4fbb-953c-0cde1c4ca053"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:32.294122 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-ddad0d78-e9bc-492f-a67d-0139c9a954c1 req-713d63f1-2d1d-4f0b-a177-f43d1b36eaa9 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:32.295075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-ddad0d78-e9bc-492f-a67d-0139c9a954c1 req-713d63f1-2d1d-4f0b-a177-f43d1b36eaa9 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:32.298735 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-ddad0d78-e9bc-492f-a67d-0139c9a954c1 req-713d63f1-2d1d-4f0b-a177-f43d1b36eaa9 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:32.315491 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-ddad0d78-e9bc-492f-a67d-0139c9a954c1 req-713d63f1-2d1d-4f0b-a177-f43d1b36eaa9 service nova] Creating event network-changed:4cb866ee-2954-4fbb-953c-0cde1c4ca053 for instance 84ecc526-a083-4f47-ac70-0b06d5b66158 on hv-cinder-85220 Aug 24 16:51:32.322686 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-ddad0d78-e9bc-492f-a67d-0139c9a954c1 req-713d63f1-2d1d-4f0b-a177-f43d1b36eaa9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056327 Aug 24 16:51:32.324188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 208/413] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:34.810852 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6bd888bf-91c2-4f20-a6c5-81982ea5ca7a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Action: 'create', calling method: .version_select at 0x7fa1954669d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-341073694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIsu0Cv+wNM5qfEq4/4xBp835wKcnEJY4BXhdSyZ1qJf5oy+RtQcmjXCWYiBoQDwG6mFEScIUJjRRYcbhSEIKl4pINKuoKbOcSW0F2YwQ/68W+GbTHBBy3DkrWnNIF8qA=="}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:34.839061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-6bd888bf-91c2-4f20-a6c5-81982ea5ca7a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Getting quotas for project 1715333032634911bcf0f7a41fab587a. Resources: {'key_pairs'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:51:34.843069 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-6bd888bf-91c2-4f20-a6c5-81982ea5ca7a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Getting quotas for user 90e3f9b6511347a692bed976865d5fad and project 1715333032634911bcf0f7a41fab587a. Resources: {'key_pairs'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:51:34.949433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6bd888bf-91c2-4f20-a6c5-81982ea5ca7a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.336031 Aug 24 16:51:34.950050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 206/414] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Aug 24 16:51:34 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:15.294827 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-447179936", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-341073694", "security_groups": [{"name": "tempest-secgroup-smoke-1635703481"}], "networks": [{"uuid": "d6afcf69-3d2a-47da-86ef-5d037a1e8eee"}], "block_device_mapping_v2": [{"uuid": "dd8765cc-0b94-43be-8fb0-b300d9b001f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:15.304521 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=5 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:15.305182 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=64 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:15.409287 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] validate_networks() for [('d6afcf69-3d2a-47da-86ef-5d037a1e8eee', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:52:15.776368 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:52:15.776912 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:52:15.777739 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:52:15.778230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:52:15.778716 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:52:15.789046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:15.789736 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:15.790676 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:15.791655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:15.792139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:15.792770 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:15.810342 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Getting quotas for project 1715333032634911bcf0f7a41fab587a. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:52:15.814472 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Getting quotas for user 90e3f9b6511347a692bed976865d5fad and project 1715333032634911bcf0f7a41fab587a. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:52:15.876601 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:52:15.878794 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd8765cc-0b94-43be-8fb0-b300d9b001f1',volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:52:16.301708 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dc11bc97-6ab6-402a-bb33-da47a42a295d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.011097 Aug 24 16:52:16.302697 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 209/415] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:52:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:52:16.310656 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=33 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:16.311356 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=4 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:16.312124 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:16.315969 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-369706b9-00ed-4f22-b524-50a61d4999b0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:16.316866 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-369706b9-00ed-4f22-b524-50a61d4999b0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:16.375670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-369706b9-00ed-4f22-b524-50a61d4999b0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:16.382744 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-369706b9-00ed-4f22-b524-50a61d4999b0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1087 microversion: 2.1 time: 0.073509 Aug 24 16:52:16.383308 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 207/416] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:16 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1087 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:17.405650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8f2c7936-8a25-47c8-9e49-3bff23ad82bb tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:17.406270 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8f2c7936-8a25-47c8-9e49-3bff23ad82bb tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:17.456886 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8f2c7936-8a25-47c8-9e49-3bff23ad82bb tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:17.464119 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8f2c7936-8a25-47c8-9e49-3bff23ad82bb tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1087 microversion: 2.1 time: 0.062352 Aug 24 16:52:17.464720 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 210/417] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:17 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1087 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:18.486052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6012b4bb-b07c-4623-8648-7c1e61309e3d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:18.486052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6012b4bb-b07c-4623-8648-7c1e61309e3d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:18.547819 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6012b4bb-b07c-4623-8648-7c1e61309e3d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:18.555325 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6012b4bb-b07c-4623-8648-7c1e61309e3d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1087 microversion: 2.1 time: 0.075090 Aug 24 16:52:18.556513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 208/418] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:18 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1087 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:18.599645 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-73e22789-bd40-483e-a0dd-4965bdd752d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:18.600191 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-73e22789-bd40-483e-a0dd-4965bdd752d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:18.607304 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73e22789-bd40-483e-a0dd-4965bdd752d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:18.607781 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73e22789-bd40-483e-a0dd-4965bdd752d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:18.608214 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73e22789-bd40-483e-a0dd-4965bdd752d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:18.609231 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73e22789-bd40-483e-a0dd-4965bdd752d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:18.609684 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73e22789-bd40-483e-a0dd-4965bdd752d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:18.610373 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73e22789-bd40-483e-a0dd-4965bdd752d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:18.635643 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-73e22789-bd40-483e-a0dd-4965bdd752d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/ips" status: 200 len: 151 microversion: 2.20 time: 0.039864 Aug 24 16:52:18.636219 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 211/419] 10.222.0.70 () {60 vars in 1289 bytes} [Wed Aug 24 16:52:18 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:52:19.577291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4c1d2436-af5b-4eca-909d-f27b7b78af93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:19.578007 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4c1d2436-af5b-4eca-909d-f27b7b78af93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:19.644357 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4c1d2436-af5b-4eca-909d-f27b7b78af93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:19.651788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4c1d2436-af5b-4eca-909d-f27b7b78af93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1087 microversion: 2.1 time: 0.078353 Aug 24 16:52:19.652347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 209/420] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:19 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1087 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:20.671869 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3e70978c-0374-43ea-923d-5ab1ecbd835a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:20.672503 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3e70978c-0374-43ea-923d-5ab1ecbd835a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:20.678382 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e70978c-0374-43ea-923d-5ab1ecbd835a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:20.678852 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e70978c-0374-43ea-923d-5ab1ecbd835a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:20.679283 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e70978c-0374-43ea-923d-5ab1ecbd835a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:20.679983 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e70978c-0374-43ea-923d-5ab1ecbd835a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:20.680447 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e70978c-0374-43ea-923d-5ab1ecbd835a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:20.680866 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e70978c-0374-43ea-923d-5ab1ecbd835a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:20.742220 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3e70978c-0374-43ea-923d-5ab1ecbd835a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:20.750162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3e70978c-0374-43ea-923d-5ab1ecbd835a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1137 microversion: 2.1 time: 0.082201 Aug 24 16:52:20.750724 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 212/421] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:20 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:21.770765 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5e1b04d2-2be4-4601-abdf-6585b9d4635d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:21.771384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5e1b04d2-2be4-4601-abdf-6585b9d4635d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:21.777618 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e1b04d2-2be4-4601-abdf-6585b9d4635d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:21.778102 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e1b04d2-2be4-4601-abdf-6585b9d4635d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:21.778536 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e1b04d2-2be4-4601-abdf-6585b9d4635d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:21.779231 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e1b04d2-2be4-4601-abdf-6585b9d4635d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:21.779682 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e1b04d2-2be4-4601-abdf-6585b9d4635d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:21.780106 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e1b04d2-2be4-4601-abdf-6585b9d4635d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:21.840374 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-5e1b04d2-2be4-4601-abdf-6585b9d4635d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:21.848166 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5e1b04d2-2be4-4601-abdf-6585b9d4635d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1137 microversion: 2.1 time: 0.081561 Aug 24 16:52:21.848800 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 210/422] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:21 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:21.990810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-82dd52c4-db00-41f6-a7ce-816b0996bef6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:21.991581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-82dd52c4-db00-41f6-a7ce-816b0996bef6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:21.997348 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82dd52c4-db00-41f6-a7ce-816b0996bef6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:21.997832 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82dd52c4-db00-41f6-a7ce-816b0996bef6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:21.998269 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82dd52c4-db00-41f6-a7ce-816b0996bef6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:21.998957 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82dd52c4-db00-41f6-a7ce-816b0996bef6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:21.999698 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82dd52c4-db00-41f6-a7ce-816b0996bef6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:22.000149 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82dd52c4-db00-41f6-a7ce-816b0996bef6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:22.023491 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-82dd52c4-db00-41f6-a7ce-816b0996bef6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lazy-loading 'flavor' on Instance uuid 6d2cca9b-5df9-43a4-9791-633eab746eeb {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:52:22.481820 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-82dd52c4-db00-41f6-a7ce-816b0996bef6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "POST /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/action" status: 202 len: 0 microversion: 2.20 time: 0.494774 Aug 24 16:52:22.482405 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 213/423] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Aug 24 16:52:21 2022] POST /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:52:22.494002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c6957217-c6bb-4c41-bb5c-be1d8027594d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:22.494812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c6957217-c6bb-4c41-bb5c-be1d8027594d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:22.501134 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6957217-c6bb-4c41-bb5c-be1d8027594d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:22.501579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6957217-c6bb-4c41-bb5c-be1d8027594d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:22.502020 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6957217-c6bb-4c41-bb5c-be1d8027594d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:22.502729 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6957217-c6bb-4c41-bb5c-be1d8027594d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:22.503253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6957217-c6bb-4c41-bb5c-be1d8027594d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:22.503648 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6957217-c6bb-4c41-bb5c-be1d8027594d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:22.648824 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c6957217-c6bb-4c41-bb5c-be1d8027594d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:22.660206 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c6957217-c6bb-4c41-bb5c-be1d8027594d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:22.661725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c6957217-c6bb-4c41-bb5c-be1d8027594d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:22.662917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c6957217-c6bb-4c41-bb5c-be1d8027594d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.175956 Aug 24 16:52:22.663471 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 211/424] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:22 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:22.870563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-eeec5061-088a-4ec7-9f36-e340c5f613cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:22.871264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-eeec5061-088a-4ec7-9f36-e340c5f613cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:22.877790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eeec5061-088a-4ec7-9f36-e340c5f613cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:22.878269 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eeec5061-088a-4ec7-9f36-e340c5f613cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:22.878701 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eeec5061-088a-4ec7-9f36-e340c5f613cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:22.879395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eeec5061-088a-4ec7-9f36-e340c5f613cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:22.879842 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eeec5061-088a-4ec7-9f36-e340c5f613cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:22.880264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eeec5061-088a-4ec7-9f36-e340c5f613cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:22.944765 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eeec5061-088a-4ec7-9f36-e340c5f613cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:22.953264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-eeec5061-088a-4ec7-9f36-e340c5f613cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1193 microversion: 2.1 time: 0.087646 Aug 24 16:52:22.954000 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 214/425] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:22 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:23.461313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8b960912-48da-4a68-a4c4-71330073632d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:23.462406 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8b960912-48da-4a68-a4c4-71330073632d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:23.468596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8b960912-48da-4a68-a4c4-71330073632d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:23.469079 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8b960912-48da-4a68-a4c4-71330073632d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:23.469513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8b960912-48da-4a68-a4c4-71330073632d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:23.470193 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8b960912-48da-4a68-a4c4-71330073632d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:23.470645 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8b960912-48da-4a68-a4c4-71330073632d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:23.471066 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8b960912-48da-4a68-a4c4-71330073632d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:23.495128 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8b960912-48da-4a68-a4c4-71330073632d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/ips" status: 200 len: 148 microversion: 2.1 time: 0.037712 Aug 24 16:52:23.495709 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 212/426] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Aug 24 16:52:23 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:23.686556 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d52a1ff0-5673-4a45-b8b3-d0e72d9246ea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:23.687244 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d52a1ff0-5673-4a45-b8b3-d0e72d9246ea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:23.693464 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d52a1ff0-5673-4a45-b8b3-d0e72d9246ea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:23.693951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d52a1ff0-5673-4a45-b8b3-d0e72d9246ea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:23.694381 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d52a1ff0-5673-4a45-b8b3-d0e72d9246ea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:23.695113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d52a1ff0-5673-4a45-b8b3-d0e72d9246ea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:23.695564 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d52a1ff0-5673-4a45-b8b3-d0e72d9246ea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:23.695987 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d52a1ff0-5673-4a45-b8b3-d0e72d9246ea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:23.832635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d52a1ff0-5673-4a45-b8b3-d0e72d9246ea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:23.841406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d52a1ff0-5673-4a45-b8b3-d0e72d9246ea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:23.842909 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d52a1ff0-5673-4a45-b8b3-d0e72d9246ea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:23.844128 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d52a1ff0-5673-4a45-b8b3-d0e72d9246ea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.161893 Aug 24 16:52:23.845258 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 215/427] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:23 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:23.974589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-64a94326-d119-4fa2-a404-b7ecc622aa93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:23.975875 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-64a94326-d119-4fa2-a404-b7ecc622aa93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:23.982291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-64a94326-d119-4fa2-a404-b7ecc622aa93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:23.982910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-64a94326-d119-4fa2-a404-b7ecc622aa93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:23.983349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-64a94326-d119-4fa2-a404-b7ecc622aa93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:23.984046 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-64a94326-d119-4fa2-a404-b7ecc622aa93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:23.984535 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-64a94326-d119-4fa2-a404-b7ecc622aa93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:23.984960 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-64a94326-d119-4fa2-a404-b7ecc622aa93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:24.125796 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-64a94326-d119-4fa2-a404-b7ecc622aa93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:24.134029 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-64a94326-d119-4fa2-a404-b7ecc622aa93 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1271 microversion: 2.1 time: 0.163353 Aug 24 16:52:24.134686 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 213/428] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:23 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:24.623393 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-72255ec0-81fc-4a28-b09f-44e79c30ec87 req-27f18ed5-8ac2-4e20-b721-f676072e040b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62dfce7d-d2d5-4695-948f-8381f4ea6a91", "tag": "3cf062b3-088f-4bbb-91b9-d4ca915fdc9c"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:24.632876 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-72255ec0-81fc-4a28-b09f-44e79c30ec87 req-27f18ed5-8ac2-4e20-b721-f676072e040b service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:24.633353 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-72255ec0-81fc-4a28-b09f-44e79c30ec87 req-27f18ed5-8ac2-4e20-b721-f676072e040b service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:24.634292 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-72255ec0-81fc-4a28-b09f-44e79c30ec87 req-27f18ed5-8ac2-4e20-b721-f676072e040b service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:24.645137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-72255ec0-81fc-4a28-b09f-44e79c30ec87 req-27f18ed5-8ac2-4e20-b721-f676072e040b service nova] Creating event network-changed:3cf062b3-088f-4bbb-91b9-d4ca915fdc9c for instance 62dfce7d-d2d5-4695-948f-8381f4ea6a91 on hv-cinder-85220 Aug 24 16:52:24.650269 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-72255ec0-81fc-4a28-b09f-44e79c30ec87 req-27f18ed5-8ac2-4e20-b721-f676072e040b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029878 Aug 24 16:52:24.651083 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 216/429] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:24.867459 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-36de2f46-c7e8-443a-9e8d-094dadc73d9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:24.868427 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-36de2f46-c7e8-443a-9e8d-094dadc73d9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:24.875203 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36de2f46-c7e8-443a-9e8d-094dadc73d9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:24.875890 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36de2f46-c7e8-443a-9e8d-094dadc73d9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:24.876321 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36de2f46-c7e8-443a-9e8d-094dadc73d9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:24.877048 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36de2f46-c7e8-443a-9e8d-094dadc73d9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:24.877502 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36de2f46-c7e8-443a-9e8d-094dadc73d9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:24.877950 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36de2f46-c7e8-443a-9e8d-094dadc73d9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:25.010255 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-36de2f46-c7e8-443a-9e8d-094dadc73d9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:25.018396 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-36de2f46-c7e8-443a-9e8d-094dadc73d9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:25.019874 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-36de2f46-c7e8-443a-9e8d-094dadc73d9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:25.021084 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-36de2f46-c7e8-443a-9e8d-094dadc73d9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.157613 Aug 24 16:52:25.021639 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 214/430] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:24 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:25.155602 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-720e091a-e567-4314-af4c-bf3a0c2762ea tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:25.156473 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-720e091a-e567-4314-af4c-bf3a0c2762ea tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:25.162657 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-720e091a-e567-4314-af4c-bf3a0c2762ea tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:25.163205 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-720e091a-e567-4314-af4c-bf3a0c2762ea tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:25.163703 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-720e091a-e567-4314-af4c-bf3a0c2762ea tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:25.164484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-720e091a-e567-4314-af4c-bf3a0c2762ea tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:25.165006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-720e091a-e567-4314-af4c-bf3a0c2762ea tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:25.165513 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-720e091a-e567-4314-af4c-bf3a0c2762ea tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:25.310638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-720e091a-e567-4314-af4c-bf3a0c2762ea tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:25.318552 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-720e091a-e567-4314-af4c-bf3a0c2762ea tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.167233 Aug 24 16:52:25.319123 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 217/431] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:25 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:26.043440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1f224156-1b32-4fe2-8c93-469610af21b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:26.044112 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1f224156-1b32-4fe2-8c93-469610af21b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:26.050401 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f224156-1b32-4fe2-8c93-469610af21b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:26.050887 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f224156-1b32-4fe2-8c93-469610af21b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:26.051328 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f224156-1b32-4fe2-8c93-469610af21b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:26.052026 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f224156-1b32-4fe2-8c93-469610af21b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:26.052513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f224156-1b32-4fe2-8c93-469610af21b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:26.052942 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f224156-1b32-4fe2-8c93-469610af21b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:26.184237 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1f224156-1b32-4fe2-8c93-469610af21b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:26.192359 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1f224156-1b32-4fe2-8c93-469610af21b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:26.193883 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1f224156-1b32-4fe2-8c93-469610af21b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:26.195093 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1f224156-1b32-4fe2-8c93-469610af21b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.155980 Aug 24 16:52:26.195648 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 215/432] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:26 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:26.327622 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1f7ba610-4ba9-481c-8b07-89db47c3fe76 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb0bc09c-1d33-48b2-86cb-97f213f9bb4a"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:26.330236 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1f7ba610-4ba9-481c-8b07-89db47c3fe76 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:26.332435 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:26.337364 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f7ba610-4ba9-481c-8b07-89db47c3fe76 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:26.337845 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f7ba610-4ba9-481c-8b07-89db47c3fe76 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:26.338284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f7ba610-4ba9-481c-8b07-89db47c3fe76 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:26.338979 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f7ba610-4ba9-481c-8b07-89db47c3fe76 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:26.344051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f7ba610-4ba9-481c-8b07-89db47c3fe76 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:26.344051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f7ba610-4ba9-481c-8b07-89db47c3fe76 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:26.344473 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-66f766fb-4ad5-4fa8-b5fa-9107c3439b72 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:26.344473 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-66f766fb-4ad5-4fa8-b5fa-9107c3439b72 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:26.348318 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66f766fb-4ad5-4fa8-b5fa-9107c3439b72 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:26.348890 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66f766fb-4ad5-4fa8-b5fa-9107c3439b72 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:26.349329 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66f766fb-4ad5-4fa8-b5fa-9107c3439b72 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:26.350026 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66f766fb-4ad5-4fa8-b5fa-9107c3439b72 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:26.350482 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66f766fb-4ad5-4fa8-b5fa-9107c3439b72 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:26.350906 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66f766fb-4ad5-4fa8-b5fa-9107c3439b72 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:26.484303 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-66f766fb-4ad5-4fa8-b5fa-9107c3439b72 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:26.491907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-66f766fb-4ad5-4fa8-b5fa-9107c3439b72 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.154056 Aug 24 16:52:26.492488 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 216/433] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:26 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:52:27.219317 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-81ab7bd5-c87f-419b-948a-957559f87039 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:27.220078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-81ab7bd5-c87f-419b-948a-957559f87039 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:27.226686 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-81ab7bd5-c87f-419b-948a-957559f87039 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:27.227200 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-81ab7bd5-c87f-419b-948a-957559f87039 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:27.227630 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-81ab7bd5-c87f-419b-948a-957559f87039 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:27.228347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-81ab7bd5-c87f-419b-948a-957559f87039 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:27.228822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-81ab7bd5-c87f-419b-948a-957559f87039 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:27.229242 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-81ab7bd5-c87f-419b-948a-957559f87039 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:27.363955 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-81ab7bd5-c87f-419b-948a-957559f87039 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:27.372638 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-81ab7bd5-c87f-419b-948a-957559f87039 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:27.374137 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-81ab7bd5-c87f-419b-948a-957559f87039 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:27.375551 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-81ab7bd5-c87f-419b-948a-957559f87039 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.160517 Aug 24 16:52:27.376106 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 217/434] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:27 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:52:27.461069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=8 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:27.514708 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a70fdd9c-4182-4e93-987f-0cd4868f0d99 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:27.515313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a70fdd9c-4182-4e93-987f-0cd4868f0d99 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:27.521184 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a70fdd9c-4182-4e93-987f-0cd4868f0d99 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:27.521662 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a70fdd9c-4182-4e93-987f-0cd4868f0d99 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:27.522088 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a70fdd9c-4182-4e93-987f-0cd4868f0d99 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:27.522762 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a70fdd9c-4182-4e93-987f-0cd4868f0d99 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:27.523210 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a70fdd9c-4182-4e93-987f-0cd4868f0d99 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:27.523626 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a70fdd9c-4182-4e93-987f-0cd4868f0d99 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:27.653747 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a70fdd9c-4182-4e93-987f-0cd4868f0d99 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:27.657147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1f7ba610-4ba9-481c-8b07-89db47c3fe76 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "POST /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.333453 Aug 24 16:52:27.663084 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a70fdd9c-4182-4e93-987f-0cd4868f0d99 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.150930 Aug 24 16:52:27.663084 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 218/436] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:27 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:52:27.663645 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 218/436] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 16:52:26 2022] POST /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/os-volume_attachments => generated 194 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:28.399157 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-daaaabf9-fe17-4a46-9964-03bf1cb88c0e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:28.400316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-daaaabf9-fe17-4a46-9964-03bf1cb88c0e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:28.406777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-daaaabf9-fe17-4a46-9964-03bf1cb88c0e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:28.407521 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-daaaabf9-fe17-4a46-9964-03bf1cb88c0e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:28.407762 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-daaaabf9-fe17-4a46-9964-03bf1cb88c0e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:28.408487 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-daaaabf9-fe17-4a46-9964-03bf1cb88c0e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:28.408950 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-daaaabf9-fe17-4a46-9964-03bf1cb88c0e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:28.409377 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-daaaabf9-fe17-4a46-9964-03bf1cb88c0e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:28.541530 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-daaaabf9-fe17-4a46-9964-03bf1cb88c0e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:28.550136 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-daaaabf9-fe17-4a46-9964-03bf1cb88c0e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:28.551644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-daaaabf9-fe17-4a46-9964-03bf1cb88c0e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:28.552841 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-daaaabf9-fe17-4a46-9964-03bf1cb88c0e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.157869 Aug 24 16:52:28.554013 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 219/437] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:28 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:28.691297 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-66d214b6-148e-4753-ad83-2c0ab2b55273 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:28.692070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-66d214b6-148e-4753-ad83-2c0ab2b55273 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:28.698552 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66d214b6-148e-4753-ad83-2c0ab2b55273 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:28.699042 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66d214b6-148e-4753-ad83-2c0ab2b55273 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:28.699536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66d214b6-148e-4753-ad83-2c0ab2b55273 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:28.700258 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66d214b6-148e-4753-ad83-2c0ab2b55273 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:28.700732 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66d214b6-148e-4753-ad83-2c0ab2b55273 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:28.701159 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66d214b6-148e-4753-ad83-2c0ab2b55273 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:28.842312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-66d214b6-148e-4753-ad83-2c0ab2b55273 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:28.850473 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-66d214b6-148e-4753-ad83-2c0ab2b55273 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.164191 Aug 24 16:52:28.851057 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 219/438] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:28 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:29.577050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3a9292f1-0a88-43d1-b098-fb32aa558006 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:29.577660 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3a9292f1-0a88-43d1-b098-fb32aa558006 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:29.583964 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3a9292f1-0a88-43d1-b098-fb32aa558006 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:29.584475 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3a9292f1-0a88-43d1-b098-fb32aa558006 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:29.584911 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3a9292f1-0a88-43d1-b098-fb32aa558006 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:29.585635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3a9292f1-0a88-43d1-b098-fb32aa558006 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:29.586090 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3a9292f1-0a88-43d1-b098-fb32aa558006 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:29.586505 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3a9292f1-0a88-43d1-b098-fb32aa558006 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:29.648773 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=6 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:29.724820 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3a9292f1-0a88-43d1-b098-fb32aa558006 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:29.732850 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3a9292f1-0a88-43d1-b098-fb32aa558006 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:29.734336 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3a9292f1-0a88-43d1-b098-fb32aa558006 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:29.735481 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3a9292f1-0a88-43d1-b098-fb32aa558006 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.162969 Aug 24 16:52:29.736054 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 220/439] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:29 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:29.871779 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5ebb891d-f9b1-4325-970f-0b595cab067a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:29.872416 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5ebb891d-f9b1-4325-970f-0b595cab067a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:29.879076 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ebb891d-f9b1-4325-970f-0b595cab067a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:29.879562 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ebb891d-f9b1-4325-970f-0b595cab067a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:29.879996 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ebb891d-f9b1-4325-970f-0b595cab067a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:29.880710 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ebb891d-f9b1-4325-970f-0b595cab067a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:29.881167 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ebb891d-f9b1-4325-970f-0b595cab067a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:29.881632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ebb891d-f9b1-4325-970f-0b595cab067a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:30.010595 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5ebb891d-f9b1-4325-970f-0b595cab067a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:30.018237 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5ebb891d-f9b1-4325-970f-0b595cab067a tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.150876 Aug 24 16:52:30.018796 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 220/440] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:29 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:30.758654 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c5dbd516-0807-42dc-a18c-a9ad325ea44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:30.759268 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c5dbd516-0807-42dc-a18c-a9ad325ea44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:30.766138 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c5dbd516-0807-42dc-a18c-a9ad325ea44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:30.766623 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c5dbd516-0807-42dc-a18c-a9ad325ea44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:30.767063 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c5dbd516-0807-42dc-a18c-a9ad325ea44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:30.767756 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c5dbd516-0807-42dc-a18c-a9ad325ea44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:30.768215 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c5dbd516-0807-42dc-a18c-a9ad325ea44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:30.768676 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c5dbd516-0807-42dc-a18c-a9ad325ea44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:30.895434 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c5dbd516-0807-42dc-a18c-a9ad325ea44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:30.903780 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c5dbd516-0807-42dc-a18c-a9ad325ea44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:30.905298 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c5dbd516-0807-42dc-a18c-a9ad325ea44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:30.906445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c5dbd516-0807-42dc-a18c-a9ad325ea44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.151659 Aug 24 16:52:30.907850 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 221/441] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:30 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:31.038547 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1eccb718-87e3-4f20-8d71-e14545a7b309 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:31.039068 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1eccb718-87e3-4f20-8d71-e14545a7b309 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:31.045447 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1eccb718-87e3-4f20-8d71-e14545a7b309 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:31.045928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1eccb718-87e3-4f20-8d71-e14545a7b309 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:31.046361 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1eccb718-87e3-4f20-8d71-e14545a7b309 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:31.047043 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1eccb718-87e3-4f20-8d71-e14545a7b309 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:31.047492 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1eccb718-87e3-4f20-8d71-e14545a7b309 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:31.047914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1eccb718-87e3-4f20-8d71-e14545a7b309 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:31.177458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1eccb718-87e3-4f20-8d71-e14545a7b309 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:31.185717 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1eccb718-87e3-4f20-8d71-e14545a7b309 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.151131 Aug 24 16:52:31.186283 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 221/442] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:31 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:31.929653 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-231f6c0f-ebcb-4de6-96b4-c4fb54469f2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:31.930125 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-231f6c0f-ebcb-4de6-96b4-c4fb54469f2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:31.937005 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-231f6c0f-ebcb-4de6-96b4-c4fb54469f2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:31.937557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-231f6c0f-ebcb-4de6-96b4-c4fb54469f2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:31.937991 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-231f6c0f-ebcb-4de6-96b4-c4fb54469f2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:31.938683 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-231f6c0f-ebcb-4de6-96b4-c4fb54469f2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:31.939208 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-231f6c0f-ebcb-4de6-96b4-c4fb54469f2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:31.939629 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-231f6c0f-ebcb-4de6-96b4-c4fb54469f2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:32.063476 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-231f6c0f-ebcb-4de6-96b4-c4fb54469f2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:32.071645 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-231f6c0f-ebcb-4de6-96b4-c4fb54469f2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:32.073699 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-231f6c0f-ebcb-4de6-96b4-c4fb54469f2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:32.074851 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-231f6c0f-ebcb-4de6-96b4-c4fb54469f2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.149391 Aug 24 16:52:32.075569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 222/443] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:31 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:32.213534 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8b0e46a1-ca0d-4d0e-84df-21c90b57bf7b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:32.213534 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8b0e46a1-ca0d-4d0e-84df-21c90b57bf7b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:32.214643 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8b0e46a1-ca0d-4d0e-84df-21c90b57bf7b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:32.214794 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8b0e46a1-ca0d-4d0e-84df-21c90b57bf7b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:32.215221 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8b0e46a1-ca0d-4d0e-84df-21c90b57bf7b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:32.215944 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8b0e46a1-ca0d-4d0e-84df-21c90b57bf7b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:32.216353 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8b0e46a1-ca0d-4d0e-84df-21c90b57bf7b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:32.216797 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8b0e46a1-ca0d-4d0e-84df-21c90b57bf7b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:32.349776 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8b0e46a1-ca0d-4d0e-84df-21c90b57bf7b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:32.357543 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8b0e46a1-ca0d-4d0e-84df-21c90b57bf7b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.154858 Aug 24 16:52:32.358107 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 222/444] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:32 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:33.097948 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b015a3ac-85d0-4980-a340-dc25f9d1ec13 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:33.098553 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b015a3ac-85d0-4980-a340-dc25f9d1ec13 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:33.104859 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b015a3ac-85d0-4980-a340-dc25f9d1ec13 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:33.105336 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b015a3ac-85d0-4980-a340-dc25f9d1ec13 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:33.105768 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b015a3ac-85d0-4980-a340-dc25f9d1ec13 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:33.106448 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b015a3ac-85d0-4980-a340-dc25f9d1ec13 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:33.106899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b015a3ac-85d0-4980-a340-dc25f9d1ec13 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:33.107313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b015a3ac-85d0-4980-a340-dc25f9d1ec13 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:33.234764 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b015a3ac-85d0-4980-a340-dc25f9d1ec13 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:33.242830 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b015a3ac-85d0-4980-a340-dc25f9d1ec13 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:33.244310 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b015a3ac-85d0-4980-a340-dc25f9d1ec13 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:33.246008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b015a3ac-85d0-4980-a340-dc25f9d1ec13 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.151892 Aug 24 16:52:33.246562 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 223/445] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:33 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:33.378266 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-52802ffe-be8c-4876-a5d0-785c74fffd95 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:33.379044 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-52802ffe-be8c-4876-a5d0-785c74fffd95 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:33.385348 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52802ffe-be8c-4876-a5d0-785c74fffd95 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:33.386333 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52802ffe-be8c-4876-a5d0-785c74fffd95 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:33.386764 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52802ffe-be8c-4876-a5d0-785c74fffd95 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:33.387452 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52802ffe-be8c-4876-a5d0-785c74fffd95 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:33.387904 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52802ffe-be8c-4876-a5d0-785c74fffd95 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:33.388329 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52802ffe-be8c-4876-a5d0-785c74fffd95 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:33.513291 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-52802ffe-be8c-4876-a5d0-785c74fffd95 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:33.520773 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-52802ffe-be8c-4876-a5d0-785c74fffd95 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.146544 Aug 24 16:52:33.521469 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 223/446] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:33 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:34.269563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-97d49bc1-b1e5-4d54-8567-69bc11d20dcf tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:34.270177 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-97d49bc1-b1e5-4d54-8567-69bc11d20dcf tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:34.277318 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-97d49bc1-b1e5-4d54-8567-69bc11d20dcf tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:34.277807 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-97d49bc1-b1e5-4d54-8567-69bc11d20dcf tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:34.278247 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-97d49bc1-b1e5-4d54-8567-69bc11d20dcf tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:34.278937 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-97d49bc1-b1e5-4d54-8567-69bc11d20dcf tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:34.279392 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-97d49bc1-b1e5-4d54-8567-69bc11d20dcf tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:34.279817 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-97d49bc1-b1e5-4d54-8567-69bc11d20dcf tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:34.408604 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-97d49bc1-b1e5-4d54-8567-69bc11d20dcf tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:34.416696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-97d49bc1-b1e5-4d54-8567-69bc11d20dcf tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:34.418198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-97d49bc1-b1e5-4d54-8567-69bc11d20dcf tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:34.419364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-97d49bc1-b1e5-4d54-8567-69bc11d20dcf tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.153709 Aug 24 16:52:34.419925 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 224/447] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:34 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:34.541534 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e0b2fca8-9b42-4d3c-b9fd-44509cf5b937 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:34.542097 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e0b2fca8-9b42-4d3c-b9fd-44509cf5b937 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:34.548534 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e0b2fca8-9b42-4d3c-b9fd-44509cf5b937 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:34.549011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e0b2fca8-9b42-4d3c-b9fd-44509cf5b937 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:34.549443 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e0b2fca8-9b42-4d3c-b9fd-44509cf5b937 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:34.550126 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e0b2fca8-9b42-4d3c-b9fd-44509cf5b937 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:34.550574 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e0b2fca8-9b42-4d3c-b9fd-44509cf5b937 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:34.550991 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e0b2fca8-9b42-4d3c-b9fd-44509cf5b937 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:34.678485 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e0b2fca8-9b42-4d3c-b9fd-44509cf5b937 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:34.681976 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:34.686980 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e0b2fca8-9b42-4d3c-b9fd-44509cf5b937 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.149408 Aug 24 16:52:34.687537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 224/448] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:34 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:35.442410 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fd8ec7fa-7e03-4bdb-a588-1288102b0aea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:35.443026 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fd8ec7fa-7e03-4bdb-a588-1288102b0aea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:35.449372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd8ec7fa-7e03-4bdb-a588-1288102b0aea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:35.449862 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd8ec7fa-7e03-4bdb-a588-1288102b0aea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:35.450301 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd8ec7fa-7e03-4bdb-a588-1288102b0aea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:35.450994 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd8ec7fa-7e03-4bdb-a588-1288102b0aea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:35.451447 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd8ec7fa-7e03-4bdb-a588-1288102b0aea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:35.451874 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd8ec7fa-7e03-4bdb-a588-1288102b0aea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:35.583853 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fd8ec7fa-7e03-4bdb-a588-1288102b0aea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:35.592605 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fd8ec7fa-7e03-4bdb-a588-1288102b0aea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:35.594098 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fd8ec7fa-7e03-4bdb-a588-1288102b0aea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:35.595260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fd8ec7fa-7e03-4bdb-a588-1288102b0aea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.156726 Aug 24 16:52:35.595821 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 225/449] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:35 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:35.708333 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-66f24d17-d99b-496c-a3a1-5300b33f0fef tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:35.709024 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-66f24d17-d99b-496c-a3a1-5300b33f0fef tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:35.716764 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66f24d17-d99b-496c-a3a1-5300b33f0fef tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:35.717233 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66f24d17-d99b-496c-a3a1-5300b33f0fef tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:35.717676 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66f24d17-d99b-496c-a3a1-5300b33f0fef tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:35.718365 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66f24d17-d99b-496c-a3a1-5300b33f0fef tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:35.718826 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66f24d17-d99b-496c-a3a1-5300b33f0fef tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:35.719248 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66f24d17-d99b-496c-a3a1-5300b33f0fef tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:35.850223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-66f24d17-d99b-496c-a3a1-5300b33f0fef tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:35.858088 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-66f24d17-d99b-496c-a3a1-5300b33f0fef tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.153576 Aug 24 16:52:35.858657 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 225/450] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:35 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:36.237661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d0e86d0c-0646-4010-8c33-6840d2a63717 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Action: 'create', calling method: .version_select at 0x7fa195466790>, body: {"keypair": {"name": "tempest-keypair-797435066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStmo9n1VNBFA2cLT9Kq/Q9e6ba0NsKM1eEM7G1vv4MGpYpDshZQO/lLSE4iZRgoangCOkOkcNhAVUpCxl7LbhbuV6Z2pUXBgdr2oj5doQ2a6Yxre0DYsuBtzwy1ePjUQ=="}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:36.253542 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-d0e86d0c-0646-4010-8c33-6840d2a63717 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for project 6b5b284e0b47422592057492601db382. Resources: {'key_pairs'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:52:36.257299 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-d0e86d0c-0646-4010-8c33-6840d2a63717 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for user 88efd5eb09064aa2aa89e6d9580c6476 and project 6b5b284e0b47422592057492601db382. Resources: {'key_pairs'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:52:36.375636 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d0e86d0c-0646-4010-8c33-6840d2a63717 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141731 Aug 24 16:52:36.376235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 226/451] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Aug 24 16:52:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:36.618624 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7dd97de2-6dee-42f3-8940-1bc10c394a51 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:36.619219 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7dd97de2-6dee-42f3-8940-1bc10c394a51 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:36.626364 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dd97de2-6dee-42f3-8940-1bc10c394a51 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:36.627026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dd97de2-6dee-42f3-8940-1bc10c394a51 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:36.627527 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dd97de2-6dee-42f3-8940-1bc10c394a51 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:36.628291 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dd97de2-6dee-42f3-8940-1bc10c394a51 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:36.629614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dd97de2-6dee-42f3-8940-1bc10c394a51 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:36.630216 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dd97de2-6dee-42f3-8940-1bc10c394a51 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:36.763636 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7dd97de2-6dee-42f3-8940-1bc10c394a51 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:36.771650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7dd97de2-6dee-42f3-8940-1bc10c394a51 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:36.773434 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7dd97de2-6dee-42f3-8940-1bc10c394a51 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:36.774580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7dd97de2-6dee-42f3-8940-1bc10c394a51 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.159878 Aug 24 16:52:36.775141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 226/452] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:36 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:36.879304 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-db2b2ac4-fb51-4c6e-8717-89643d15d0d9 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:36.879915 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-db2b2ac4-fb51-4c6e-8717-89643d15d0d9 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:36.885843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db2b2ac4-fb51-4c6e-8717-89643d15d0d9 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:36.886332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db2b2ac4-fb51-4c6e-8717-89643d15d0d9 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:36.886766 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db2b2ac4-fb51-4c6e-8717-89643d15d0d9 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:36.887451 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db2b2ac4-fb51-4c6e-8717-89643d15d0d9 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:36.887919 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db2b2ac4-fb51-4c6e-8717-89643d15d0d9 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:36.888356 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db2b2ac4-fb51-4c6e-8717-89643d15d0d9 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:37.033256 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-db2b2ac4-fb51-4c6e-8717-89643d15d0d9 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:37.036728 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:37.041125 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-db2b2ac4-fb51-4c6e-8717-89643d15d0d9 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.166700 Aug 24 16:52:37.042342 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 227/453] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:36 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:37.797862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1fd6546e-69f8-4e5a-b256-5a91bfad2c62 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:37.798441 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1fd6546e-69f8-4e5a-b256-5a91bfad2c62 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:37.806246 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fd6546e-69f8-4e5a-b256-5a91bfad2c62 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:37.806741 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fd6546e-69f8-4e5a-b256-5a91bfad2c62 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:37.807728 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fd6546e-69f8-4e5a-b256-5a91bfad2c62 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:37.808451 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fd6546e-69f8-4e5a-b256-5a91bfad2c62 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:37.808913 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fd6546e-69f8-4e5a-b256-5a91bfad2c62 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:37.809346 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fd6546e-69f8-4e5a-b256-5a91bfad2c62 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:37.994044 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1fd6546e-69f8-4e5a-b256-5a91bfad2c62 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:38.003653 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1fd6546e-69f8-4e5a-b256-5a91bfad2c62 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:38.005375 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1fd6546e-69f8-4e5a-b256-5a91bfad2c62 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:38.006891 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1fd6546e-69f8-4e5a-b256-5a91bfad2c62 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.213320 Aug 24 16:52:38.007569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 227/454] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:37 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:38.026466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-02096eb1-61e5-4190-afff-c2098a894497 req-1b459f17-4b3b-4db9-91e6-a1e8bcda20e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62dfce7d-d2d5-4695-948f-8381f4ea6a91", "name": "network-vif-plugged", "status": "completed", "tag": "3cf062b3-088f-4bbb-91b9-d4ca915fdc9c"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:38.038208 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-02096eb1-61e5-4190-afff-c2098a894497 req-1b459f17-4b3b-4db9-91e6-a1e8bcda20e3 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:38.038725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-02096eb1-61e5-4190-afff-c2098a894497 req-1b459f17-4b3b-4db9-91e6-a1e8bcda20e3 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:38.039162 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-02096eb1-61e5-4190-afff-c2098a894497 req-1b459f17-4b3b-4db9-91e6-a1e8bcda20e3 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:38.051110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-02096eb1-61e5-4190-afff-c2098a894497 req-1b459f17-4b3b-4db9-91e6-a1e8bcda20e3 service nova] Creating event network-vif-plugged:3cf062b3-088f-4bbb-91b9-d4ca915fdc9c for instance 62dfce7d-d2d5-4695-948f-8381f4ea6a91 on hv-cinder-85220 Aug 24 16:52:38.056169 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-02096eb1-61e5-4190-afff-c2098a894497 req-1b459f17-4b3b-4db9-91e6-a1e8bcda20e3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033420 Aug 24 16:52:38.057204 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 228/455] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:38.063163 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-847f86a6-5c96-4f38-9943-d5592558ebd3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:38.063783 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-847f86a6-5c96-4f38-9943-d5592558ebd3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:38.069817 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-847f86a6-5c96-4f38-9943-d5592558ebd3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:38.070681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-847f86a6-5c96-4f38-9943-d5592558ebd3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:38.070830 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-847f86a6-5c96-4f38-9943-d5592558ebd3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:38.071441 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-847f86a6-5c96-4f38-9943-d5592558ebd3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:38.071902 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-847f86a6-5c96-4f38-9943-d5592558ebd3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:38.072323 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-847f86a6-5c96-4f38-9943-d5592558ebd3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:38.225740 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-847f86a6-5c96-4f38-9943-d5592558ebd3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:38.234100 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-847f86a6-5c96-4f38-9943-d5592558ebd3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.175276 Aug 24 16:52:38.234717 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 228/456] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:38 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:52:38.852865 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1968711293", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4108caa5-f8d0-4511-be15-eaaba4ff32ab"}], "security_groups": [{"name": "tempest-securitygroup--1946666364"}], "key_name": "tempest-keypair-797435066", "user_data": "}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:38.954746 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.network.neutron [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] validate_networks() for [('4108caa5-f8d0-4511-be15-eaaba4ff32ab', None, None, None, None, None)] {{(pid=127715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:52:39.031483 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-442a0dbe-0713-4774-9031-51ac8dec807d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:39.032077 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-442a0dbe-0713-4774-9031-51ac8dec807d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:39.038742 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-442a0dbe-0713-4774-9031-51ac8dec807d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:39.039226 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-442a0dbe-0713-4774-9031-51ac8dec807d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:39.039663 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-442a0dbe-0713-4774-9031-51ac8dec807d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:39.040361 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-442a0dbe-0713-4774-9031-51ac8dec807d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:39.040848 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-442a0dbe-0713-4774-9031-51ac8dec807d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:39.041337 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-442a0dbe-0713-4774-9031-51ac8dec807d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:39.410658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-442a0dbe-0713-4774-9031-51ac8dec807d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:39.418890 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-442a0dbe-0713-4774-9031-51ac8dec807d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:39.420421 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-442a0dbe-0713-4774-9031-51ac8dec807d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:39.421619 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-442a0dbe-0713-4774-9031-51ac8dec807d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.394093 Aug 24 16:52:39.422184 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 229/457] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:39 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:52:39.428913 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c6924174-12c4-4886-b7f0-01f90d5c1bb8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:39.428913 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c6924174-12c4-4886-b7f0-01f90d5c1bb8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:39.433340 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6924174-12c4-4886-b7f0-01f90d5c1bb8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:39.433824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6924174-12c4-4886-b7f0-01f90d5c1bb8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:39.434260 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6924174-12c4-4886-b7f0-01f90d5c1bb8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:39.434959 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6924174-12c4-4886-b7f0-01f90d5c1bb8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:39.435415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6924174-12c4-4886-b7f0-01f90d5c1bb8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:39.435841 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6924174-12c4-4886-b7f0-01f90d5c1bb8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:39.638834 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c6924174-12c4-4886-b7f0-01f90d5c1bb8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:39.646508 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c6924174-12c4-4886-b7f0-01f90d5c1bb8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.223360 Aug 24 16:52:39.647076 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 230/458] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:39 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:39.691527 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Flavor limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:52:39.692260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Image limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:52:39.692782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Flavor pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:52:39.693197 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Image pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:52:39.693650 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:52:39.702534 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:39.703027 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:39.703463 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:39.704191 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:39.704670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:39.705099 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:39.721718 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for project 6b5b284e0b47422592057492601db382. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:52:39.725595 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for user 88efd5eb09064aa2aa89e6d9580c6476 and project 6b5b284e0b47422592057492601db382. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:52:39.736997 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Going to run 1 instances... {{(pid=127715) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:52:39.739379 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:52:39.865406 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-67604048-9ac1-49a7-b5df-4dcbbd10be89 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.017143 Aug 24 16:52:39.868034 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 229/459] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:52:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:52:39.877796 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a65ac865-57f1-400e-8078-f95270efa137 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:39.878408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a65ac865-57f1-400e-8078-f95270efa137 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:39.936291 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a65ac865-57f1-400e-8078-f95270efa137 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:39.943202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a65ac865-57f1-400e-8078-f95270efa137 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1241 microversion: 2.1 time: 0.069452 Aug 24 16:52:39.943762 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 231/460] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:39 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:40.444931 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-621d3ce7-b778-4f32-99de-2607449ca023 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:40.445546 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-621d3ce7-b778-4f32-99de-2607449ca023 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:40.452880 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-621d3ce7-b778-4f32-99de-2607449ca023 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:40.453366 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-621d3ce7-b778-4f32-99de-2607449ca023 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:40.453810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-621d3ce7-b778-4f32-99de-2607449ca023 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:40.454485 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-621d3ce7-b778-4f32-99de-2607449ca023 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:40.454943 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-621d3ce7-b778-4f32-99de-2607449ca023 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:40.455367 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-621d3ce7-b778-4f32-99de-2607449ca023 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:40.583502 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-621d3ce7-b778-4f32-99de-2607449ca023 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:40.592300 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-621d3ce7-b778-4f32-99de-2607449ca023 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:40.593816 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-621d3ce7-b778-4f32-99de-2607449ca023 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:40.598086 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-621d3ce7-b778-4f32-99de-2607449ca023 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.154491 Aug 24 16:52:40.598086 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 230/461] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:40 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:40.667993 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d5082838-2c81-4ebd-8c81-3a6e614adcb3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:40.671066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d5082838-2c81-4ebd-8c81-3a6e614adcb3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:40.675844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5082838-2c81-4ebd-8c81-3a6e614adcb3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:40.676322 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5082838-2c81-4ebd-8c81-3a6e614adcb3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:40.676778 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5082838-2c81-4ebd-8c81-3a6e614adcb3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:40.677461 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5082838-2c81-4ebd-8c81-3a6e614adcb3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:40.677906 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5082838-2c81-4ebd-8c81-3a6e614adcb3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:40.678321 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5082838-2c81-4ebd-8c81-3a6e614adcb3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:40.810191 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5082838-2c81-4ebd-8c81-3a6e614adcb3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:40.817788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d5082838-2c81-4ebd-8c81-3a6e614adcb3 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.154471 Aug 24 16:52:40.818349 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 232/462] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:40 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:40.963140 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b651489e-0b32-44f9-b72a-b1f09cc9ef73 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:40.964209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b651489e-0b32-44f9-b72a-b1f09cc9ef73 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:40.970092 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b651489e-0b32-44f9-b72a-b1f09cc9ef73 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:40.970573 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b651489e-0b32-44f9-b72a-b1f09cc9ef73 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:40.971009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b651489e-0b32-44f9-b72a-b1f09cc9ef73 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:40.971693 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b651489e-0b32-44f9-b72a-b1f09cc9ef73 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:40.972148 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b651489e-0b32-44f9-b72a-b1f09cc9ef73 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:40.972610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b651489e-0b32-44f9-b72a-b1f09cc9ef73 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:41.035857 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b651489e-0b32-44f9-b72a-b1f09cc9ef73 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:41.043550 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b651489e-0b32-44f9-b72a-b1f09cc9ef73 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1245 microversion: 2.1 time: 0.084360 Aug 24 16:52:41.044113 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 231/463] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:40 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:41.618194 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-54d3fb50-75e4-44fb-95e3-ac93d80eacf0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:41.618811 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-54d3fb50-75e4-44fb-95e3-ac93d80eacf0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:41.624749 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54d3fb50-75e4-44fb-95e3-ac93d80eacf0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:41.625489 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54d3fb50-75e4-44fb-95e3-ac93d80eacf0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:41.625922 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54d3fb50-75e4-44fb-95e3-ac93d80eacf0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:41.626633 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54d3fb50-75e4-44fb-95e3-ac93d80eacf0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:41.627085 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54d3fb50-75e4-44fb-95e3-ac93d80eacf0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:41.627515 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54d3fb50-75e4-44fb-95e3-ac93d80eacf0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:41.753312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-54d3fb50-75e4-44fb-95e3-ac93d80eacf0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:41.761943 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-54d3fb50-75e4-44fb-95e3-ac93d80eacf0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:41.763443 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-54d3fb50-75e4-44fb-95e3-ac93d80eacf0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:41.764618 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-54d3fb50-75e4-44fb-95e3-ac93d80eacf0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.150363 Aug 24 16:52:41.765175 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 233/464] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:41 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:41.838575 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6e997b1d-e9f1-42e1-8908-2a3701587858 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:41.839212 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6e997b1d-e9f1-42e1-8908-2a3701587858 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:41.845543 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6e997b1d-e9f1-42e1-8908-2a3701587858 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:41.846029 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6e997b1d-e9f1-42e1-8908-2a3701587858 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:41.846468 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6e997b1d-e9f1-42e1-8908-2a3701587858 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:41.847186 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6e997b1d-e9f1-42e1-8908-2a3701587858 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:41.847645 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6e997b1d-e9f1-42e1-8908-2a3701587858 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:41.848070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6e997b1d-e9f1-42e1-8908-2a3701587858 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:41.976236 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6e997b1d-e9f1-42e1-8908-2a3701587858 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:41.984536 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6e997b1d-e9f1-42e1-8908-2a3701587858 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1259 microversion: 2.1 time: 0.149718 Aug 24 16:52:41.985102 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 232/465] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:41 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:42.064273 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-29e70a71-b749-4542-a99f-d7cee88bf618 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:42.064928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-29e70a71-b749-4542-a99f-d7cee88bf618 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:42.070796 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29e70a71-b749-4542-a99f-d7cee88bf618 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:42.071271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29e70a71-b749-4542-a99f-d7cee88bf618 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:42.071702 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29e70a71-b749-4542-a99f-d7cee88bf618 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:42.072386 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29e70a71-b749-4542-a99f-d7cee88bf618 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:42.072868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29e70a71-b749-4542-a99f-d7cee88bf618 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:42.073289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29e70a71-b749-4542-a99f-d7cee88bf618 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:42.137309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-29e70a71-b749-4542-a99f-d7cee88bf618 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:42.144744 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-29e70a71-b749-4542-a99f-d7cee88bf618 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1245 microversion: 2.1 time: 0.084277 Aug 24 16:52:42.145309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 234/466] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:42 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:42.786864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8a4c1b2f-e830-4ace-8aa5-f17856b8bc02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:42.787482 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8a4c1b2f-e830-4ace-8aa5-f17856b8bc02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:42.793943 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a4c1b2f-e830-4ace-8aa5-f17856b8bc02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:42.794424 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a4c1b2f-e830-4ace-8aa5-f17856b8bc02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:42.794861 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a4c1b2f-e830-4ace-8aa5-f17856b8bc02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:42.795547 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a4c1b2f-e830-4ace-8aa5-f17856b8bc02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:42.796003 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a4c1b2f-e830-4ace-8aa5-f17856b8bc02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:42.796452 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a4c1b2f-e830-4ace-8aa5-f17856b8bc02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:42.929106 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8a4c1b2f-e830-4ace-8aa5-f17856b8bc02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:42.937182 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8a4c1b2f-e830-4ace-8aa5-f17856b8bc02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:42.938672 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8a4c1b2f-e830-4ace-8aa5-f17856b8bc02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:42.939825 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8a4c1b2f-e830-4ace-8aa5-f17856b8bc02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1744 microversion: 2.20 time: 0.157095 Aug 24 16:52:42.940384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 233/467] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:42 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:43.005791 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-41d6e02d-bd5a-4421-94ad-403258c9959c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:43.007046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-41d6e02d-bd5a-4421-94ad-403258c9959c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:43.013787 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-41d6e02d-bd5a-4421-94ad-403258c9959c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:43.014284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-41d6e02d-bd5a-4421-94ad-403258c9959c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:43.014765 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-41d6e02d-bd5a-4421-94ad-403258c9959c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:43.015428 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-41d6e02d-bd5a-4421-94ad-403258c9959c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:43.015888 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-41d6e02d-bd5a-4421-94ad-403258c9959c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:43.016319 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-41d6e02d-bd5a-4421-94ad-403258c9959c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:43.146476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-41d6e02d-bd5a-4421-94ad-403258c9959c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:43.154955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-41d6e02d-bd5a-4421-94ad-403258c9959c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1444 microversion: 2.1 time: 0.152938 Aug 24 16:52:43.164526 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 235/468] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:43 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:43.165714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-52ab1c13-d168-44b4-9909-fb89e9b6d71d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:43.166334 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-52ab1c13-d168-44b4-9909-fb89e9b6d71d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:43.173232 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-52ab1c13-d168-44b4-9909-fb89e9b6d71d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:43.173706 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-52ab1c13-d168-44b4-9909-fb89e9b6d71d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:43.174320 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-52ab1c13-d168-44b4-9909-fb89e9b6d71d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:43.175018 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-52ab1c13-d168-44b4-9909-fb89e9b6d71d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:43.175476 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-52ab1c13-d168-44b4-9909-fb89e9b6d71d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:43.175903 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-52ab1c13-d168-44b4-9909-fb89e9b6d71d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:43.176479 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ed1352ad-f99f-49df-85a9-630dd5183443 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:43.177159 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ed1352ad-f99f-49df-85a9-630dd5183443 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:43.183064 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed1352ad-f99f-49df-85a9-630dd5183443 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:43.183567 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed1352ad-f99f-49df-85a9-630dd5183443 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:43.183986 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed1352ad-f99f-49df-85a9-630dd5183443 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:43.184871 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed1352ad-f99f-49df-85a9-630dd5183443 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:43.185368 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed1352ad-f99f-49df-85a9-630dd5183443 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:43.185795 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed1352ad-f99f-49df-85a9-630dd5183443 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:43.247734 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-52ab1c13-d168-44b4-9909-fb89e9b6d71d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:43.255951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-52ab1c13-d168-44b4-9909-fb89e9b6d71d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1237 microversion: 2.1 time: 0.094195 Aug 24 16:52:43.256739 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 234/469] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:43 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:43.341666 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ed1352ad-f99f-49df-85a9-630dd5183443 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:43.349429 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ed1352ad-f99f-49df-85a9-630dd5183443 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1444 microversion: 2.1 time: 0.176828 Aug 24 16:52:43.354492 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 236/470] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:43 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:52:43.963543 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1bf65f26-e509-489e-a307-2c938223c884 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:43.964560 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1bf65f26-e509-489e-a307-2c938223c884 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:43.971152 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1bf65f26-e509-489e-a307-2c938223c884 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:43.972259 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1bf65f26-e509-489e-a307-2c938223c884 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:43.972803 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1bf65f26-e509-489e-a307-2c938223c884 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:43.973517 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1bf65f26-e509-489e-a307-2c938223c884 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:43.974002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1bf65f26-e509-489e-a307-2c938223c884 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:43.974433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1bf65f26-e509-489e-a307-2c938223c884 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:44.109308 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1bf65f26-e509-489e-a307-2c938223c884 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:44.117632 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1bf65f26-e509-489e-a307-2c938223c884 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:44.119170 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1bf65f26-e509-489e-a307-2c938223c884 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:44.120916 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1bf65f26-e509-489e-a307-2c938223c884 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1744 microversion: 2.20 time: 0.161815 Aug 24 16:52:44.121476 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 235/471] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:43 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:44.280850 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-62b9ea70-fec5-43c3-88f0-bab8a6416871 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:44.281382 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-62b9ea70-fec5-43c3-88f0-bab8a6416871 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:44.296418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62b9ea70-fec5-43c3-88f0-bab8a6416871 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:44.297070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62b9ea70-fec5-43c3-88f0-bab8a6416871 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:44.297580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62b9ea70-fec5-43c3-88f0-bab8a6416871 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:44.298871 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62b9ea70-fec5-43c3-88f0-bab8a6416871 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:44.299477 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62b9ea70-fec5-43c3-88f0-bab8a6416871 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:44.299914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62b9ea70-fec5-43c3-88f0-bab8a6416871 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:44.372377 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-62b9ea70-fec5-43c3-88f0-bab8a6416871 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:44.380644 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-62b9ea70-fec5-43c3-88f0-bab8a6416871 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1311 microversion: 2.1 time: 0.103765 Aug 24 16:52:44.381224 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 237/472] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:44 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:45.145352 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4b3597bf-8e2f-43d2-9797-c58f5b8d65ba tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:45.146109 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4b3597bf-8e2f-43d2-9797-c58f5b8d65ba tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:45.152628 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4b3597bf-8e2f-43d2-9797-c58f5b8d65ba tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.153123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4b3597bf-8e2f-43d2-9797-c58f5b8d65ba tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.153566 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4b3597bf-8e2f-43d2-9797-c58f5b8d65ba tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.154265 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4b3597bf-8e2f-43d2-9797-c58f5b8d65ba tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.154722 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4b3597bf-8e2f-43d2-9797-c58f5b8d65ba tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.155205 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4b3597bf-8e2f-43d2-9797-c58f5b8d65ba tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.286057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4b3597bf-8e2f-43d2-9797-c58f5b8d65ba tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:45.297841 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4b3597bf-8e2f-43d2-9797-c58f5b8d65ba tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:45.300501 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4b3597bf-8e2f-43d2-9797-c58f5b8d65ba tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:45.302875 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4b3597bf-8e2f-43d2-9797-c58f5b8d65ba tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1744 microversion: 2.20 time: 0.161107 Aug 24 16:52:45.303811 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 236/473] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:45 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:45.401619 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-08a6da3f-a283-4400-babf-297c14d3867a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:45.402239 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-08a6da3f-a283-4400-babf-297c14d3867a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:45.405251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:45.410680 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08a6da3f-a283-4400-babf-297c14d3867a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.411167 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08a6da3f-a283-4400-babf-297c14d3867a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.411687 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08a6da3f-a283-4400-babf-297c14d3867a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.412362 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08a6da3f-a283-4400-babf-297c14d3867a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.412850 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08a6da3f-a283-4400-babf-297c14d3867a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.413268 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08a6da3f-a283-4400-babf-297c14d3867a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.553874 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-08a6da3f-a283-4400-babf-297c14d3867a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:45.567645 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-08a6da3f-a283-4400-babf-297c14d3867a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1367 microversion: 2.1 time: 0.169838 Aug 24 16:52:45.568237 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 238/474] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:45 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:46.260132 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-08c486f7-06b0-4e81-b3b8-87865d046fca req-a6756fd3-b91b-4bf0-8ab7-d70f65aed4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62dfce7d-d2d5-4695-948f-8381f4ea6a91", "tag": "3cf062b3-088f-4bbb-91b9-d4ca915fdc9c"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:46.273267 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-08c486f7-06b0-4e81-b3b8-87865d046fca req-a6756fd3-b91b-4bf0-8ab7-d70f65aed4f0 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:46.273876 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-08c486f7-06b0-4e81-b3b8-87865d046fca req-a6756fd3-b91b-4bf0-8ab7-d70f65aed4f0 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:46.274376 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-08c486f7-06b0-4e81-b3b8-87865d046fca req-a6756fd3-b91b-4bf0-8ab7-d70f65aed4f0 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:46.286200 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-08c486f7-06b0-4e81-b3b8-87865d046fca req-a6756fd3-b91b-4bf0-8ab7-d70f65aed4f0 service nova] Creating event network-changed:3cf062b3-088f-4bbb-91b9-d4ca915fdc9c for instance 62dfce7d-d2d5-4695-948f-8381f4ea6a91 on hv-cinder-85220 Aug 24 16:52:46.291356 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-08c486f7-06b0-4e81-b3b8-87865d046fca req-a6756fd3-b91b-4bf0-8ab7-d70f65aed4f0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035656 Aug 24 16:52:46.292217 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 237/475] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:46.329304 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b603674f-6240-4244-bb66-ed82751f2cc2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:46.330362 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b603674f-6240-4244-bb66-ed82751f2cc2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:46.336093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b603674f-6240-4244-bb66-ed82751f2cc2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:46.336750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b603674f-6240-4244-bb66-ed82751f2cc2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:46.337261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b603674f-6240-4244-bb66-ed82751f2cc2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:46.338024 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b603674f-6240-4244-bb66-ed82751f2cc2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:46.339154 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b603674f-6240-4244-bb66-ed82751f2cc2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:46.339708 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b603674f-6240-4244-bb66-ed82751f2cc2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:46.489443 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b603674f-6240-4244-bb66-ed82751f2cc2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:46.498931 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b603674f-6240-4244-bb66-ed82751f2cc2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:46.501118 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b603674f-6240-4244-bb66-ed82751f2cc2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:46.502508 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b603674f-6240-4244-bb66-ed82751f2cc2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1744 microversion: 2.20 time: 0.177429 Aug 24 16:52:46.516821 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 239/476] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:46 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1744 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:46.590108 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ad99e2a2-6bfb-4ee5-a050-be01411b152a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:46.591271 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ad99e2a2-6bfb-4ee5-a050-be01411b152a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:46.598262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad99e2a2-6bfb-4ee5-a050-be01411b152a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:46.599032 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad99e2a2-6bfb-4ee5-a050-be01411b152a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:46.600506 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad99e2a2-6bfb-4ee5-a050-be01411b152a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:46.600506 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad99e2a2-6bfb-4ee5-a050-be01411b152a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:46.601229 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad99e2a2-6bfb-4ee5-a050-be01411b152a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:46.601781 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad99e2a2-6bfb-4ee5-a050-be01411b152a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:46.738601 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ad99e2a2-6bfb-4ee5-a050-be01411b152a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:46.747973 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ad99e2a2-6bfb-4ee5-a050-be01411b152a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1367 microversion: 2.1 time: 0.162697 Aug 24 16:52:46.748624 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 238/477] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:46 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:47.528036 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d1384e38-6f5f-491d-860b-3ac6aba6fedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:47.530512 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d1384e38-6f5f-491d-860b-3ac6aba6fedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:47.547683 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1384e38-6f5f-491d-860b-3ac6aba6fedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:47.549322 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1384e38-6f5f-491d-860b-3ac6aba6fedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:47.549937 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1384e38-6f5f-491d-860b-3ac6aba6fedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:47.550657 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1384e38-6f5f-491d-860b-3ac6aba6fedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:47.551117 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1384e38-6f5f-491d-860b-3ac6aba6fedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:47.551584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1384e38-6f5f-491d-860b-3ac6aba6fedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:47.691899 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d1384e38-6f5f-491d-860b-3ac6aba6fedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:47.700570 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d1384e38-6f5f-491d-860b-3ac6aba6fedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:47.704940 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d1384e38-6f5f-491d-860b-3ac6aba6fedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:47.704940 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d1384e38-6f5f-491d-860b-3ac6aba6fedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1744 microversion: 2.20 time: 0.180046 Aug 24 16:52:47.704940 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 240/478] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:47 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:47.769135 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b6d19660-ea5d-405f-9b06-a2df0ca7df6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:47.769746 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b6d19660-ea5d-405f-9b06-a2df0ca7df6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:47.776770 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b6d19660-ea5d-405f-9b06-a2df0ca7df6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:47.777247 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b6d19660-ea5d-405f-9b06-a2df0ca7df6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:47.777671 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b6d19660-ea5d-405f-9b06-a2df0ca7df6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:47.778351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b6d19660-ea5d-405f-9b06-a2df0ca7df6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:47.778795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b6d19660-ea5d-405f-9b06-a2df0ca7df6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:47.779215 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b6d19660-ea5d-405f-9b06-a2df0ca7df6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:47.914957 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b6d19660-ea5d-405f-9b06-a2df0ca7df6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:47.922958 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b6d19660-ea5d-405f-9b06-a2df0ca7df6c tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1367 microversion: 2.1 time: 0.157550 Aug 24 16:52:47.923534 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 239/479] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:47 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:47.980147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-d68fad7b-82db-486c-b0eb-bb36b40a83f7 req-51c8f242-9ef7-44e8-b869-5dbb583bf1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2cca9b-5df9-43a4-9791-633eab746eeb", "name": "network-vif-plugged", "status": "completed", "tag": "de8a2ec3-3c1d-4c19-9833-a7a754e2b815"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:47.991622 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-d68fad7b-82db-486c-b0eb-bb36b40a83f7 req-51c8f242-9ef7-44e8-b869-5dbb583bf1ca service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:47.991622 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-d68fad7b-82db-486c-b0eb-bb36b40a83f7 req-51c8f242-9ef7-44e8-b869-5dbb583bf1ca service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:47.991622 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-d68fad7b-82db-486c-b0eb-bb36b40a83f7 req-51c8f242-9ef7-44e8-b869-5dbb583bf1ca service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:48.002564 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-d68fad7b-82db-486c-b0eb-bb36b40a83f7 req-51c8f242-9ef7-44e8-b869-5dbb583bf1ca service nova] Creating event network-vif-plugged:de8a2ec3-3c1d-4c19-9833-a7a754e2b815 for instance 6d2cca9b-5df9-43a4-9791-633eab746eeb on hv-cinder-85220 Aug 24 16:52:48.007431 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-d68fad7b-82db-486c-b0eb-bb36b40a83f7 req-51c8f242-9ef7-44e8-b869-5dbb583bf1ca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031140 Aug 24 16:52:48.008005 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 241/480] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:48.305769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-16128e6b-39b5-454d-98b1-6bb399e550f7 req-63ebcef0-ce8c-4268-b4b6-7517fad6e6ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b81578-b6c8-4fbf-9451-51d1fec79b91", "tag": "33fa5a2a-0d21-4685-9bef-eeffec861ec9"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:48.312170 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:48.315836 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-16128e6b-39b5-454d-98b1-6bb399e550f7 req-63ebcef0-ce8c-4268-b4b6-7517fad6e6ee service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:48.316309 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-16128e6b-39b5-454d-98b1-6bb399e550f7 req-63ebcef0-ce8c-4268-b4b6-7517fad6e6ee service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:48.316773 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-16128e6b-39b5-454d-98b1-6bb399e550f7 req-63ebcef0-ce8c-4268-b4b6-7517fad6e6ee service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:48.327963 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-16128e6b-39b5-454d-98b1-6bb399e550f7 req-63ebcef0-ce8c-4268-b4b6-7517fad6e6ee service nova] Creating event network-changed:33fa5a2a-0d21-4685-9bef-eeffec861ec9 for instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 on hv-cinder-85220 Aug 24 16:52:48.332656 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-16128e6b-39b5-454d-98b1-6bb399e550f7 req-63ebcef0-ce8c-4268-b4b6-7517fad6e6ee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030573 Aug 24 16:52:48.333243 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 240/481] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:48.726657 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9adff08a-abef-4506-8078-b27bc7adbeef tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:48.727261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9adff08a-abef-4506-8078-b27bc7adbeef tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:48.733540 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9adff08a-abef-4506-8078-b27bc7adbeef tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:48.734013 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9adff08a-abef-4506-8078-b27bc7adbeef tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:48.734439 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9adff08a-abef-4506-8078-b27bc7adbeef tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:48.735110 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9adff08a-abef-4506-8078-b27bc7adbeef tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:48.735555 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9adff08a-abef-4506-8078-b27bc7adbeef tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:48.735971 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9adff08a-abef-4506-8078-b27bc7adbeef tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:48.865317 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9adff08a-abef-4506-8078-b27bc7adbeef tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:48.873908 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9adff08a-abef-4506-8078-b27bc7adbeef tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:48.875654 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9adff08a-abef-4506-8078-b27bc7adbeef tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:48.876832 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9adff08a-abef-4506-8078-b27bc7adbeef tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1744 microversion: 2.20 time: 0.154988 Aug 24 16:52:48.877390 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 242/482] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:48 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:48.944283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e0a0000a-8384-4704-9d10-f0c49a2d8c03 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:48.945006 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e0a0000a-8384-4704-9d10-f0c49a2d8c03 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:48.956277 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0a0000a-8384-4704-9d10-f0c49a2d8c03 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:48.958829 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0a0000a-8384-4704-9d10-f0c49a2d8c03 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:48.958829 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0a0000a-8384-4704-9d10-f0c49a2d8c03 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:48.958829 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0a0000a-8384-4704-9d10-f0c49a2d8c03 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:48.958829 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0a0000a-8384-4704-9d10-f0c49a2d8c03 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:48.959189 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0a0000a-8384-4704-9d10-f0c49a2d8c03 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:49.092296 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e0a0000a-8384-4704-9d10-f0c49a2d8c03 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:49.099920 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e0a0000a-8384-4704-9d10-f0c49a2d8c03 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1367 microversion: 2.1 time: 0.160618 Aug 24 16:52:49.100505 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 241/483] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:48 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:49.900026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-abf88efb-0803-446e-8522-799ec2b5d4d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:49.901519 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-abf88efb-0803-446e-8522-799ec2b5d4d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:49.907909 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abf88efb-0803-446e-8522-799ec2b5d4d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:49.908392 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abf88efb-0803-446e-8522-799ec2b5d4d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:49.908857 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abf88efb-0803-446e-8522-799ec2b5d4d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:49.909545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abf88efb-0803-446e-8522-799ec2b5d4d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:49.909997 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abf88efb-0803-446e-8522-799ec2b5d4d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:49.910421 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abf88efb-0803-446e-8522-799ec2b5d4d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:49.914396 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=100 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:49.940346 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:50.038596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-abf88efb-0803-446e-8522-799ec2b5d4d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:50.046620 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-abf88efb-0803-446e-8522-799ec2b5d4d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:50.048108 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-abf88efb-0803-446e-8522-799ec2b5d4d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:50.049290 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-abf88efb-0803-446e-8522-799ec2b5d4d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1744 microversion: 2.20 time: 0.153202 Aug 24 16:52:50.049844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 243/484] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:49 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:50.120095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b93d963b-216c-483b-a8b0-52e46aee685b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:50.120744 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b93d963b-216c-483b-a8b0-52e46aee685b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:50.122708 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:50.123509 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=10 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:50.128769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b93d963b-216c-483b-a8b0-52e46aee685b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:50.129255 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b93d963b-216c-483b-a8b0-52e46aee685b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:50.129694 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b93d963b-216c-483b-a8b0-52e46aee685b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:50.130388 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b93d963b-216c-483b-a8b0-52e46aee685b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:50.130846 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b93d963b-216c-483b-a8b0-52e46aee685b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:50.131281 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b93d963b-216c-483b-a8b0-52e46aee685b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:50.262725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b93d963b-216c-483b-a8b0-52e46aee685b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:50.275161 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b93d963b-216c-483b-a8b0-52e46aee685b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1367 microversion: 2.1 time: 0.154245 Aug 24 16:52:50.275161 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 242/485] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:50 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:51.072792 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7add13b2-5533-40b9-a787-3696b6444ea9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:51.073400 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7add13b2-5533-40b9-a787-3696b6444ea9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:51.079810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7add13b2-5533-40b9-a787-3696b6444ea9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:51.080510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7add13b2-5533-40b9-a787-3696b6444ea9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:51.080939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7add13b2-5533-40b9-a787-3696b6444ea9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:51.081624 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7add13b2-5533-40b9-a787-3696b6444ea9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:51.082071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7add13b2-5533-40b9-a787-3696b6444ea9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:51.082486 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7add13b2-5533-40b9-a787-3696b6444ea9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:51.210104 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7add13b2-5533-40b9-a787-3696b6444ea9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:51.218858 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7add13b2-5533-40b9-a787-3696b6444ea9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:51.220343 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7add13b2-5533-40b9-a787-3696b6444ea9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:51.222569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7add13b2-5533-40b9-a787-3696b6444ea9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1744 microversion: 2.20 time: 0.153092 Aug 24 16:52:51.222569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 244/486] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:51 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:51.293928 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fa7e2670-c3bb-4e8a-a90d-2c5f723cabdb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:51.294531 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fa7e2670-c3bb-4e8a-a90d-2c5f723cabdb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:51.300900 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa7e2670-c3bb-4e8a-a90d-2c5f723cabdb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:51.301385 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa7e2670-c3bb-4e8a-a90d-2c5f723cabdb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:51.301836 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa7e2670-c3bb-4e8a-a90d-2c5f723cabdb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:51.302536 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa7e2670-c3bb-4e8a-a90d-2c5f723cabdb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:51.302988 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa7e2670-c3bb-4e8a-a90d-2c5f723cabdb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:51.309409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa7e2670-c3bb-4e8a-a90d-2c5f723cabdb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:51.449844 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fa7e2670-c3bb-4e8a-a90d-2c5f723cabdb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:51.458107 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fa7e2670-c3bb-4e8a-a90d-2c5f723cabdb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1367 microversion: 2.1 time: 0.168721 Aug 24 16:52:51.458689 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 243/487] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:51 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:52.245696 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-47adb6d1-f3ff-44ee-ae96-f04205a7de93 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:52.246312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-47adb6d1-f3ff-44ee-ae96-f04205a7de93 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:52.253145 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47adb6d1-f3ff-44ee-ae96-f04205a7de93 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:52.253634 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47adb6d1-f3ff-44ee-ae96-f04205a7de93 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:52.254118 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47adb6d1-f3ff-44ee-ae96-f04205a7de93 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:52.254812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47adb6d1-f3ff-44ee-ae96-f04205a7de93 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:52.255262 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47adb6d1-f3ff-44ee-ae96-f04205a7de93 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:52.255687 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47adb6d1-f3ff-44ee-ae96-f04205a7de93 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:52.385701 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-47adb6d1-f3ff-44ee-ae96-f04205a7de93 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:52.394065 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-47adb6d1-f3ff-44ee-ae96-f04205a7de93 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:52.395580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-47adb6d1-f3ff-44ee-ae96-f04205a7de93 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:52.396789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-47adb6d1-f3ff-44ee-ae96-f04205a7de93 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1744 microversion: 2.20 time: 0.155528 Aug 24 16:52:52.398869 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 245/488] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:52 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:52:52.479697 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-320c2436-d8bb-43bd-9091-cdc682b49dcb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:52.480311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-320c2436-d8bb-43bd-9091-cdc682b49dcb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:52.486801 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-320c2436-d8bb-43bd-9091-cdc682b49dcb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:52.487282 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-320c2436-d8bb-43bd-9091-cdc682b49dcb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:52.487720 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-320c2436-d8bb-43bd-9091-cdc682b49dcb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:52.488422 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-320c2436-d8bb-43bd-9091-cdc682b49dcb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:52.488894 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-320c2436-d8bb-43bd-9091-cdc682b49dcb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:52.489322 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-320c2436-d8bb-43bd-9091-cdc682b49dcb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:52.617548 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-320c2436-d8bb-43bd-9091-cdc682b49dcb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:52.626039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-320c2436-d8bb-43bd-9091-cdc682b49dcb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1367 microversion: 2.1 time: 0.150774 Aug 24 16:52:52.626609 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 244/489] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:52 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:53.419928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-df14126a-0e6d-4497-8444-8e1200a08192 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:53.421180 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-df14126a-0e6d-4497-8444-8e1200a08192 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:53.427739 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df14126a-0e6d-4497-8444-8e1200a08192 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:53.428219 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df14126a-0e6d-4497-8444-8e1200a08192 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:53.428671 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df14126a-0e6d-4497-8444-8e1200a08192 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:53.429359 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df14126a-0e6d-4497-8444-8e1200a08192 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:53.429811 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df14126a-0e6d-4497-8444-8e1200a08192 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:53.430229 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df14126a-0e6d-4497-8444-8e1200a08192 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:53.564014 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-df14126a-0e6d-4497-8444-8e1200a08192 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:53.572216 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-df14126a-0e6d-4497-8444-8e1200a08192 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:53.574412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-df14126a-0e6d-4497-8444-8e1200a08192 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:53.575558 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-df14126a-0e6d-4497-8444-8e1200a08192 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1744 microversion: 2.20 time: 0.159721 Aug 24 16:52:53.576362 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 246/490] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:53 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:53.646949 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8e2ea442-c968-400d-ae67-9b9813a3bd80 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:53.647591 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8e2ea442-c968-400d-ae67-9b9813a3bd80 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:53.654073 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8e2ea442-c968-400d-ae67-9b9813a3bd80 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:53.654561 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8e2ea442-c968-400d-ae67-9b9813a3bd80 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:53.657930 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8e2ea442-c968-400d-ae67-9b9813a3bd80 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:53.657930 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8e2ea442-c968-400d-ae67-9b9813a3bd80 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:53.657930 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8e2ea442-c968-400d-ae67-9b9813a3bd80 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:53.657930 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8e2ea442-c968-400d-ae67-9b9813a3bd80 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:53.802080 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8e2ea442-c968-400d-ae67-9b9813a3bd80 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:53.810401 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8e2ea442-c968-400d-ae67-9b9813a3bd80 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1367 microversion: 2.1 time: 0.167306 Aug 24 16:52:53.810972 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 245/491] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:53 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:54.209447 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-0ef9ae38-d5ef-4374-9631-a9f3a1485ad2 req-6bfe7b34-daee-4aef-b2ef-a342268fb244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b81578-b6c8-4fbf-9451-51d1fec79b91", "name": "network-vif-plugged", "status": "completed", "tag": "33fa5a2a-0d21-4685-9bef-eeffec861ec9"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:54.220981 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-0ef9ae38-d5ef-4374-9631-a9f3a1485ad2 req-6bfe7b34-daee-4aef-b2ef-a342268fb244 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:54.220981 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-0ef9ae38-d5ef-4374-9631-a9f3a1485ad2 req-6bfe7b34-daee-4aef-b2ef-a342268fb244 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:54.220981 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-0ef9ae38-d5ef-4374-9631-a9f3a1485ad2 req-6bfe7b34-daee-4aef-b2ef-a342268fb244 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:54.233851 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-0ef9ae38-d5ef-4374-9631-a9f3a1485ad2 req-6bfe7b34-daee-4aef-b2ef-a342268fb244 service nova] Creating event network-vif-plugged:33fa5a2a-0d21-4685-9bef-eeffec861ec9 for instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 on hv-cinder-85220 Aug 24 16:52:54.239054 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-0ef9ae38-d5ef-4374-9631-a9f3a1485ad2 req-6bfe7b34-daee-4aef-b2ef-a342268fb244 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033487 Aug 24 16:52:54.240018 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 247/492] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:54.598208 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4e3e65fe-4871-42b7-ae54-f2e08b498190 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:54.599089 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4e3e65fe-4871-42b7-ae54-f2e08b498190 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:54.605175 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4e3e65fe-4871-42b7-ae54-f2e08b498190 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:54.605662 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4e3e65fe-4871-42b7-ae54-f2e08b498190 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:54.606100 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4e3e65fe-4871-42b7-ae54-f2e08b498190 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:54.606797 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4e3e65fe-4871-42b7-ae54-f2e08b498190 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:54.607259 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4e3e65fe-4871-42b7-ae54-f2e08b498190 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:54.607682 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4e3e65fe-4871-42b7-ae54-f2e08b498190 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:54.743868 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4e3e65fe-4871-42b7-ae54-f2e08b498190 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:54.751601 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4e3e65fe-4871-42b7-ae54-f2e08b498190 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:54.753434 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4e3e65fe-4871-42b7-ae54-f2e08b498190 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:54.754605 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4e3e65fe-4871-42b7-ae54-f2e08b498190 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1739 microversion: 2.20 time: 0.160245 Aug 24 16:52:54.755153 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 246/493] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:54 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:54.835369 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-abfdf2c8-c96b-4743-8768-e679ee4b4de2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:54.836068 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-abfdf2c8-c96b-4743-8768-e679ee4b4de2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:54.843738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abfdf2c8-c96b-4743-8768-e679ee4b4de2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:54.844213 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abfdf2c8-c96b-4743-8768-e679ee4b4de2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:54.844809 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abfdf2c8-c96b-4743-8768-e679ee4b4de2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:54.852588 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abfdf2c8-c96b-4743-8768-e679ee4b4de2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:54.852588 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abfdf2c8-c96b-4743-8768-e679ee4b4de2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:54.852588 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abfdf2c8-c96b-4743-8768-e679ee4b4de2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:54.979150 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-abfdf2c8-c96b-4743-8768-e679ee4b4de2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:54.987156 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-abfdf2c8-c96b-4743-8768-e679ee4b4de2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1367 microversion: 2.1 time: 0.155952 Aug 24 16:52:54.987928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 248/494] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:54 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:55.781153 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4277fcba-1c74-4081-80db-cc3c778b3c69 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:55.781783 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4277fcba-1c74-4081-80db-cc3c778b3c69 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:55.794790 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4277fcba-1c74-4081-80db-cc3c778b3c69 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:55.795605 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4277fcba-1c74-4081-80db-cc3c778b3c69 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:55.796139 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4277fcba-1c74-4081-80db-cc3c778b3c69 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:55.796925 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4277fcba-1c74-4081-80db-cc3c778b3c69 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:55.797864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4277fcba-1c74-4081-80db-cc3c778b3c69 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:55.798474 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4277fcba-1c74-4081-80db-cc3c778b3c69 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:55.804659 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:56.009064 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2a884a63-670a-40ef-aba5-2986302d1956 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:56.009928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2a884a63-670a-40ef-aba5-2986302d1956 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:56.022747 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a884a63-670a-40ef-aba5-2986302d1956 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:56.023593 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a884a63-670a-40ef-aba5-2986302d1956 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:56.024366 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a884a63-670a-40ef-aba5-2986302d1956 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:56.025050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a884a63-670a-40ef-aba5-2986302d1956 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:56.027354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a884a63-670a-40ef-aba5-2986302d1956 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:56.027811 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a884a63-670a-40ef-aba5-2986302d1956 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:56.345532 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2a884a63-670a-40ef-aba5-2986302d1956 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:56.352666 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4277fcba-1c74-4081-80db-cc3c778b3c69 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:56.354898 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2a884a63-670a-40ef-aba5-2986302d1956 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1367 microversion: 2.1 time: 0.349764 Aug 24 16:52:56.355737 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 249/495] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:56 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:56.362166 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4277fcba-1c74-4081-80db-cc3c778b3c69 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:56.363941 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4277fcba-1c74-4081-80db-cc3c778b3c69 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:56.365367 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4277fcba-1c74-4081-80db-cc3c778b3c69 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1739 microversion: 2.20 time: 0.588258 Aug 24 16:52:56.365921 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 247/496] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:55 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1739 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:57.377911 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b7100eb7-f595-478e-8af4-a1cc7db76f22 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:57.378925 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b7100eb7-f595-478e-8af4-a1cc7db76f22 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:57.385068 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7100eb7-f595-478e-8af4-a1cc7db76f22 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:57.392936 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4c1916b5-df4e-4e93-a02f-d75578837508 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:57.397232 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4c1916b5-df4e-4e93-a02f-d75578837508 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:57.397367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7100eb7-f595-478e-8af4-a1cc7db76f22 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:57.397367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7100eb7-f595-478e-8af4-a1cc7db76f22 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:57.397719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7100eb7-f595-478e-8af4-a1cc7db76f22 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:57.398364 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7100eb7-f595-478e-8af4-a1cc7db76f22 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:57.398947 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7100eb7-f595-478e-8af4-a1cc7db76f22 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:57.403608 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4c1916b5-df4e-4e93-a02f-d75578837508 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:57.404371 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4c1916b5-df4e-4e93-a02f-d75578837508 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:57.404934 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4c1916b5-df4e-4e93-a02f-d75578837508 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:57.405742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4c1916b5-df4e-4e93-a02f-d75578837508 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:57.406298 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4c1916b5-df4e-4e93-a02f-d75578837508 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:57.406995 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4c1916b5-df4e-4e93-a02f-d75578837508 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:57.684080 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4c1916b5-df4e-4e93-a02f-d75578837508 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:57.698166 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4c1916b5-df4e-4e93-a02f-d75578837508 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:57.702445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4c1916b5-df4e-4e93-a02f-d75578837508 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:57.708327 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4c1916b5-df4e-4e93-a02f-d75578837508 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1739 microversion: 2.20 time: 0.319608 Aug 24 16:52:57.709302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 248/497] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:57 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1739 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:52:57.857491 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b7100eb7-f595-478e-8af4-a1cc7db76f22 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:57.866267 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b7100eb7-f595-478e-8af4-a1cc7db76f22 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1556 microversion: 2.1 time: 0.492777 Aug 24 16:52:57.866944 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 250/498] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:57 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1556 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:57.888106 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-dd5574a1-3748-463d-ac35-67e9a2a913fd tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:57.890734 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-dd5574a1-3748-463d-ac35-67e9a2a913fd tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:57.895335 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dd5574a1-3748-463d-ac35-67e9a2a913fd tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:57.895928 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dd5574a1-3748-463d-ac35-67e9a2a913fd tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:57.896457 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dd5574a1-3748-463d-ac35-67e9a2a913fd tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:57.897354 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dd5574a1-3748-463d-ac35-67e9a2a913fd tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:57.898054 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dd5574a1-3748-463d-ac35-67e9a2a913fd tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:57.898638 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dd5574a1-3748-463d-ac35-67e9a2a913fd tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:57.986619 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-dd5574a1-3748-463d-ac35-67e9a2a913fd tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102489 Aug 24 16:52:57.987306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 249/499] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Aug 24 16:52:57 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:58.731464 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7d76f964-a81c-4e41-ac21-adca55c23d04 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:58.732078 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7d76f964-a81c-4e41-ac21-adca55c23d04 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:58.738464 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d76f964-a81c-4e41-ac21-adca55c23d04 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:58.741591 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d76f964-a81c-4e41-ac21-adca55c23d04 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:58.741591 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d76f964-a81c-4e41-ac21-adca55c23d04 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:58.741591 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d76f964-a81c-4e41-ac21-adca55c23d04 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:58.741591 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d76f964-a81c-4e41-ac21-adca55c23d04 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:58.741961 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d76f964-a81c-4e41-ac21-adca55c23d04 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:58.909387 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7d76f964-a81c-4e41-ac21-adca55c23d04 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:58.919699 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7d76f964-a81c-4e41-ac21-adca55c23d04 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:58.921539 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7d76f964-a81c-4e41-ac21-adca55c23d04 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:58.922977 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7d76f964-a81c-4e41-ac21-adca55c23d04 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1739 microversion: 2.20 time: 0.195657 Aug 24 16:52:58.924056 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 251/500] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:58 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:52:59.433325 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-e7989774-cd08-4285-aa45-4f57ff4cdb2a req-b774eb06-5d32-475d-a4ce-5fe756f54736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b81578-b6c8-4fbf-9451-51d1fec79b91", "tag": "33fa5a2a-0d21-4685-9bef-eeffec861ec9"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:59.443621 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-e7989774-cd08-4285-aa45-4f57ff4cdb2a req-b774eb06-5d32-475d-a4ce-5fe756f54736 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:59.444105 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-e7989774-cd08-4285-aa45-4f57ff4cdb2a req-b774eb06-5d32-475d-a4ce-5fe756f54736 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:59.446682 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-e7989774-cd08-4285-aa45-4f57ff4cdb2a req-b774eb06-5d32-475d-a4ce-5fe756f54736 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:59.467363 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-e7989774-cd08-4285-aa45-4f57ff4cdb2a req-b774eb06-5d32-475d-a4ce-5fe756f54736 service nova] Creating event network-changed:33fa5a2a-0d21-4685-9bef-eeffec861ec9 for instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 on hv-cinder-85220 Aug 24 16:52:59.473893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-e7989774-cd08-4285-aa45-4f57ff4cdb2a req-b774eb06-5d32-475d-a4ce-5fe756f54736 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044340 Aug 24 16:52:59.474508 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 250/501] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:59.949550 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7cfcd154-c3be-434f-a7ca-e1c38a83948b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:59.950788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7cfcd154-c3be-434f-a7ca-e1c38a83948b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:59.964662 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cfcd154-c3be-434f-a7ca-e1c38a83948b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:59.964662 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cfcd154-c3be-434f-a7ca-e1c38a83948b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:59.964662 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cfcd154-c3be-434f-a7ca-e1c38a83948b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:59.964662 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cfcd154-c3be-434f-a7ca-e1c38a83948b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:59.965089 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cfcd154-c3be-434f-a7ca-e1c38a83948b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:59.969455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cfcd154-c3be-434f-a7ca-e1c38a83948b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:00.133754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7cfcd154-c3be-434f-a7ca-e1c38a83948b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:00.144068 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7cfcd154-c3be-434f-a7ca-e1c38a83948b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:00.145840 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7cfcd154-c3be-434f-a7ca-e1c38a83948b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:00.148003 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7cfcd154-c3be-434f-a7ca-e1c38a83948b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1739 microversion: 2.20 time: 0.202610 Aug 24 16:53:00.149623 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 252/502] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:52:59 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:01.172842 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2351ecfe-f8e6-4a0a-a480-2fc8ce843eb0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:01.174901 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2351ecfe-f8e6-4a0a-a480-2fc8ce843eb0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:01.183385 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2351ecfe-f8e6-4a0a-a480-2fc8ce843eb0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:01.184175 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2351ecfe-f8e6-4a0a-a480-2fc8ce843eb0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:01.184819 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2351ecfe-f8e6-4a0a-a480-2fc8ce843eb0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:01.185740 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2351ecfe-f8e6-4a0a-a480-2fc8ce843eb0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:01.186494 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2351ecfe-f8e6-4a0a-a480-2fc8ce843eb0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:01.186924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2351ecfe-f8e6-4a0a-a480-2fc8ce843eb0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:01.351167 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2351ecfe-f8e6-4a0a-a480-2fc8ce843eb0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:01.360751 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2351ecfe-f8e6-4a0a-a480-2fc8ce843eb0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:01.362697 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2351ecfe-f8e6-4a0a-a480-2fc8ce843eb0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:01.363892 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2351ecfe-f8e6-4a0a-a480-2fc8ce843eb0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1739 microversion: 2.20 time: 0.195429 Aug 24 16:53:01.364472 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 251/503] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:01 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:02.391005 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-665f729b-8dab-4d7e-873d-557cadcb7ac1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:02.392345 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-665f729b-8dab-4d7e-873d-557cadcb7ac1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:02.399271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-665f729b-8dab-4d7e-873d-557cadcb7ac1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:02.400051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-665f729b-8dab-4d7e-873d-557cadcb7ac1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:02.400779 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-665f729b-8dab-4d7e-873d-557cadcb7ac1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:02.401678 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-665f729b-8dab-4d7e-873d-557cadcb7ac1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:02.402154 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-665f729b-8dab-4d7e-873d-557cadcb7ac1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:02.402561 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-665f729b-8dab-4d7e-873d-557cadcb7ac1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:02.555438 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-665f729b-8dab-4d7e-873d-557cadcb7ac1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:02.565006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-665f729b-8dab-4d7e-873d-557cadcb7ac1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:02.567012 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-665f729b-8dab-4d7e-873d-557cadcb7ac1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:02.567970 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-665f729b-8dab-4d7e-873d-557cadcb7ac1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1739 microversion: 2.20 time: 0.181053 Aug 24 16:53:02.580969 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 253/504] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:02 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:03.591870 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0e5e30e1-16e6-454e-9cb8-83eff0ef085c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:03.592504 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0e5e30e1-16e6-454e-9cb8-83eff0ef085c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:03.599271 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0e5e30e1-16e6-454e-9cb8-83eff0ef085c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:03.599870 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0e5e30e1-16e6-454e-9cb8-83eff0ef085c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:03.600339 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0e5e30e1-16e6-454e-9cb8-83eff0ef085c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:03.601087 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0e5e30e1-16e6-454e-9cb8-83eff0ef085c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:03.601544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0e5e30e1-16e6-454e-9cb8-83eff0ef085c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:03.602203 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0e5e30e1-16e6-454e-9cb8-83eff0ef085c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:03.753331 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0e5e30e1-16e6-454e-9cb8-83eff0ef085c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:03.762360 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0e5e30e1-16e6-454e-9cb8-83eff0ef085c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:03.763890 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0e5e30e1-16e6-454e-9cb8-83eff0ef085c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:03.765071 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0e5e30e1-16e6-454e-9cb8-83eff0ef085c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1739 microversion: 2.20 time: 0.177749 Aug 24 16:53:03.780769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 252/505] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:03 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:04.788677 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-95d1fcae-c534-45e0-9d8a-be70640ee09d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:04.789563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-95d1fcae-c534-45e0-9d8a-be70640ee09d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:04.797133 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95d1fcae-c534-45e0-9d8a-be70640ee09d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:04.797823 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95d1fcae-c534-45e0-9d8a-be70640ee09d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:04.798272 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95d1fcae-c534-45e0-9d8a-be70640ee09d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:04.799049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95d1fcae-c534-45e0-9d8a-be70640ee09d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:04.800308 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95d1fcae-c534-45e0-9d8a-be70640ee09d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:04.800783 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95d1fcae-c534-45e0-9d8a-be70640ee09d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:04.945554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-95d1fcae-c534-45e0-9d8a-be70640ee09d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:04.955342 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-95d1fcae-c534-45e0-9d8a-be70640ee09d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:04.956881 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-95d1fcae-c534-45e0-9d8a-be70640ee09d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:04.958048 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-95d1fcae-c534-45e0-9d8a-be70640ee09d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1739 microversion: 2.20 time: 0.173888 Aug 24 16:53:04.958608 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 254/506] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:04 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:05.982643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-267260f5-a24f-40ce-a30c-c02d6f28a0d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:05.983248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-267260f5-a24f-40ce-a30c-c02d6f28a0d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:05.991506 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-267260f5-a24f-40ce-a30c-c02d6f28a0d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:05.992273 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-267260f5-a24f-40ce-a30c-c02d6f28a0d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:05.993109 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-267260f5-a24f-40ce-a30c-c02d6f28a0d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:05.993994 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-267260f5-a24f-40ce-a30c-c02d6f28a0d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:05.995194 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-267260f5-a24f-40ce-a30c-c02d6f28a0d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:05.996148 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-267260f5-a24f-40ce-a30c-c02d6f28a0d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:06.134298 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-267260f5-a24f-40ce-a30c-c02d6f28a0d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:06.142942 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-267260f5-a24f-40ce-a30c-c02d6f28a0d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:06.144438 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-267260f5-a24f-40ce-a30c-c02d6f28a0d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:06.145789 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-267260f5-a24f-40ce-a30c-c02d6f28a0d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1739 microversion: 2.20 time: 0.167618 Aug 24 16:53:06.146821 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 253/507] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:05 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:07.169232 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9654f1c2-e99e-4bf1-aa30-312ccf346758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:07.169851 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9654f1c2-e99e-4bf1-aa30-312ccf346758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:07.176540 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9654f1c2-e99e-4bf1-aa30-312ccf346758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:07.177014 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9654f1c2-e99e-4bf1-aa30-312ccf346758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:07.177439 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9654f1c2-e99e-4bf1-aa30-312ccf346758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:07.178122 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9654f1c2-e99e-4bf1-aa30-312ccf346758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:07.178566 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9654f1c2-e99e-4bf1-aa30-312ccf346758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:07.178980 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9654f1c2-e99e-4bf1-aa30-312ccf346758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:07.318427 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9654f1c2-e99e-4bf1-aa30-312ccf346758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:07.327757 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9654f1c2-e99e-4bf1-aa30-312ccf346758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:07.329961 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9654f1c2-e99e-4bf1-aa30-312ccf346758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:07.331253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9654f1c2-e99e-4bf1-aa30-312ccf346758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1739 microversion: 2.20 time: 0.165918 Aug 24 16:53:07.331879 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 255/508] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:07 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:08.463576 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7ffd4fcb-3d1a-44ba-8c84-4d2622893fe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:08.464194 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7ffd4fcb-3d1a-44ba-8c84-4d2622893fe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:08.470567 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7ffd4fcb-3d1a-44ba-8c84-4d2622893fe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:08.471062 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7ffd4fcb-3d1a-44ba-8c84-4d2622893fe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:08.471489 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7ffd4fcb-3d1a-44ba-8c84-4d2622893fe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:08.472367 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7ffd4fcb-3d1a-44ba-8c84-4d2622893fe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:08.473042 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7ffd4fcb-3d1a-44ba-8c84-4d2622893fe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:08.473473 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7ffd4fcb-3d1a-44ba-8c84-4d2622893fe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:08.617886 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7ffd4fcb-3d1a-44ba-8c84-4d2622893fe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:08.626728 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7ffd4fcb-3d1a-44ba-8c84-4d2622893fe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:08.628229 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7ffd4fcb-3d1a-44ba-8c84-4d2622893fe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:08.629423 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7ffd4fcb-3d1a-44ba-8c84-4d2622893fe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1721 microversion: 2.20 time: 0.279607 Aug 24 16:53:08.629984 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 254/509] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:08 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:09.531694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:53:09.532217 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Wed Aug 24 16:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:53:09.653633 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cdca5a7a-4ad5-4efe-bfcc-efa4d337ac20 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:09.654236 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cdca5a7a-4ad5-4efe-bfcc-efa4d337ac20 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:09.660693 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdca5a7a-4ad5-4efe-bfcc-efa4d337ac20 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:09.661174 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdca5a7a-4ad5-4efe-bfcc-efa4d337ac20 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:09.661604 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdca5a7a-4ad5-4efe-bfcc-efa4d337ac20 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:09.662285 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdca5a7a-4ad5-4efe-bfcc-efa4d337ac20 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:09.662731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdca5a7a-4ad5-4efe-bfcc-efa4d337ac20 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:09.663150 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdca5a7a-4ad5-4efe-bfcc-efa4d337ac20 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:09.795207 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cdca5a7a-4ad5-4efe-bfcc-efa4d337ac20 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:09.803179 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cdca5a7a-4ad5-4efe-bfcc-efa4d337ac20 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:09.804694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cdca5a7a-4ad5-4efe-bfcc-efa4d337ac20 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:09.805838 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cdca5a7a-4ad5-4efe-bfcc-efa4d337ac20 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1721 microversion: 2.20 time: 0.156887 Aug 24 16:53:09.806387 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 256/510] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:09 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:10.828148 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a0e14f7d-f2b6-4b32-9265-1a8a3a962fd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:10.828780 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a0e14f7d-f2b6-4b32-9265-1a8a3a962fd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:10.835132 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a0e14f7d-f2b6-4b32-9265-1a8a3a962fd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:10.835610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a0e14f7d-f2b6-4b32-9265-1a8a3a962fd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:10.836039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a0e14f7d-f2b6-4b32-9265-1a8a3a962fd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:10.836749 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a0e14f7d-f2b6-4b32-9265-1a8a3a962fd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:10.837198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a0e14f7d-f2b6-4b32-9265-1a8a3a962fd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:10.837648 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a0e14f7d-f2b6-4b32-9265-1a8a3a962fd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:10.972871 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a0e14f7d-f2b6-4b32-9265-1a8a3a962fd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:10.981575 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a0e14f7d-f2b6-4b32-9265-1a8a3a962fd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:10.983099 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a0e14f7d-f2b6-4b32-9265-1a8a3a962fd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:10.984425 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a0e14f7d-f2b6-4b32-9265-1a8a3a962fd2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1721 microversion: 2.20 time: 0.160183 Aug 24 16:53:10.985011 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 255/511] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:10 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:12.007996 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d1e6129e-dd15-4b7c-96a1-63fc85aea9e3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:12.008668 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d1e6129e-dd15-4b7c-96a1-63fc85aea9e3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:12.016173 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1e6129e-dd15-4b7c-96a1-63fc85aea9e3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:12.020944 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1e6129e-dd15-4b7c-96a1-63fc85aea9e3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:12.021403 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1e6129e-dd15-4b7c-96a1-63fc85aea9e3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:12.022127 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1e6129e-dd15-4b7c-96a1-63fc85aea9e3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:12.023479 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1e6129e-dd15-4b7c-96a1-63fc85aea9e3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:12.023939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1e6129e-dd15-4b7c-96a1-63fc85aea9e3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:12.136654 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-319c46ab-88ea-454c-b801-66ddfef556d4 req-13c5c392-596a-4683-86cc-623143b97529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2cca9b-5df9-43a4-9791-633eab746eeb", "name": "network-vif-unplugged", "status": "completed", "tag": "de8a2ec3-3c1d-4c19-9833-a7a754e2b815"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:12.148472 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-319c46ab-88ea-454c-b801-66ddfef556d4 req-13c5c392-596a-4683-86cc-623143b97529 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:12.152416 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-319c46ab-88ea-454c-b801-66ddfef556d4 req-13c5c392-596a-4683-86cc-623143b97529 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:12.152416 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-319c46ab-88ea-454c-b801-66ddfef556d4 req-13c5c392-596a-4683-86cc-623143b97529 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:12.161839 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.compute.server_external_events [req-319c46ab-88ea-454c-b801-66ddfef556d4 req-13c5c392-596a-4683-86cc-623143b97529 service nova] Unable to find a host for instance 6d2cca9b-5df9-43a4-9791-633eab746eeb. Dropping event network-vif-unplugged {{(pid=127715) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 16:53:12.162958 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-319c46ab-88ea-454c-b801-66ddfef556d4 req-13c5c392-596a-4683-86cc-623143b97529 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030163 Aug 24 16:53:12.163556 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 256/512] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 16:53:12.174477 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d1e6129e-dd15-4b7c-96a1-63fc85aea9e3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:12.182820 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d1e6129e-dd15-4b7c-96a1-63fc85aea9e3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:12.184299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d1e6129e-dd15-4b7c-96a1-63fc85aea9e3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:12.185461 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d1e6129e-dd15-4b7c-96a1-63fc85aea9e3 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1664 microversion: 2.20 time: 0.181378 Aug 24 16:53:12.186012 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 257/513] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:12 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1664 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:12.210734 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-223fb849-4030-45b0-a3f6-3d35faadcb68 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a49142fc-1b41-4d9c-a703-87a67bca1d88"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:12.213832 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-223fb849-4030-45b0-a3f6-3d35faadcb68 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:12.220265 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-223fb849-4030-45b0-a3f6-3d35faadcb68 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:12.220779 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-223fb849-4030-45b0-a3f6-3d35faadcb68 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:12.221266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-223fb849-4030-45b0-a3f6-3d35faadcb68 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:12.221958 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-223fb849-4030-45b0-a3f6-3d35faadcb68 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:12.222410 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-223fb849-4030-45b0-a3f6-3d35faadcb68 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:12.222852 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-223fb849-4030-45b0-a3f6-3d35faadcb68 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:13.277382 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-223fb849-4030-45b0-a3f6-3d35faadcb68 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "POST /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.070576 Aug 24 16:53:13.278161 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 257/514] 10.222.0.70 () {62 vars in 1364 bytes} [Wed Aug 24 16:53:12 2022] POST /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-volume_attachments => generated 188 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:53:13.414982 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-563fd1ab-b950-406a-8e3f-f2d44215d67d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:13.415591 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-563fd1ab-b950-406a-8e3f-f2d44215d67d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:13.422383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-563fd1ab-b950-406a-8e3f-f2d44215d67d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:13.422879 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-563fd1ab-b950-406a-8e3f-f2d44215d67d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:13.423324 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-563fd1ab-b950-406a-8e3f-f2d44215d67d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:13.424042 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-563fd1ab-b950-406a-8e3f-f2d44215d67d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:13.424528 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-563fd1ab-b950-406a-8e3f-f2d44215d67d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:13.424963 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-563fd1ab-b950-406a-8e3f-f2d44215d67d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:13.561995 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-563fd1ab-b950-406a-8e3f-f2d44215d67d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127716) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 16:53:13.838802 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-563fd1ab-b950-406a-8e3f-f2d44215d67d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "POST /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/action" status: 202 len: 0 microversion: 2.20 time: 0.427677 Aug 24 16:53:13.839317 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 258/515] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Aug 24 16:53:13 2022] POST /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:53:13.847445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-db266b78-4ea9-4396-8855-78c39c9d24ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:13.848091 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-db266b78-4ea9-4396-8855-78c39c9d24ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:13.854587 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db266b78-4ea9-4396-8855-78c39c9d24ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:13.855291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db266b78-4ea9-4396-8855-78c39c9d24ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:13.855908 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db266b78-4ea9-4396-8855-78c39c9d24ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:13.856658 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db266b78-4ea9-4396-8855-78c39c9d24ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:13.857116 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db266b78-4ea9-4396-8855-78c39c9d24ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:13.857617 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-db266b78-4ea9-4396-8855-78c39c9d24ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:13.987761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-db266b78-4ea9-4396-8855-78c39c9d24ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:13.997021 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-db266b78-4ea9-4396-8855-78c39c9d24ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:13.998551 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-db266b78-4ea9-4396-8855-78c39c9d24ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:13.999708 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-db266b78-4ea9-4396-8855-78c39c9d24ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1750 microversion: 2.20 time: 0.156185 Aug 24 16:53:14.000468 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 258/516] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:13 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:15.023626 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-731c4351-e6e3-40ff-87ff-46dca38dab31 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:15.024242 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-731c4351-e6e3-40ff-87ff-46dca38dab31 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:15.030828 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-731c4351-e6e3-40ff-87ff-46dca38dab31 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:15.031307 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-731c4351-e6e3-40ff-87ff-46dca38dab31 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:15.031741 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-731c4351-e6e3-40ff-87ff-46dca38dab31 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:15.032448 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-731c4351-e6e3-40ff-87ff-46dca38dab31 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:15.032913 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-731c4351-e6e3-40ff-87ff-46dca38dab31 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:15.033337 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-731c4351-e6e3-40ff-87ff-46dca38dab31 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:15.050884 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:15.170701 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-731c4351-e6e3-40ff-87ff-46dca38dab31 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:15.179705 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-731c4351-e6e3-40ff-87ff-46dca38dab31 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:15.181227 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-731c4351-e6e3-40ff-87ff-46dca38dab31 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:15.182928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-731c4351-e6e3-40ff-87ff-46dca38dab31 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1750 microversion: 2.20 time: 0.163678 Aug 24 16:53:15.188627 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 259/517] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:15 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:16.207041 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8f7e21e3-d528-4ab9-96db-282b19b68df2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:16.207629 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8f7e21e3-d528-4ab9-96db-282b19b68df2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:16.214888 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f7e21e3-d528-4ab9-96db-282b19b68df2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:16.215367 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f7e21e3-d528-4ab9-96db-282b19b68df2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:16.215803 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f7e21e3-d528-4ab9-96db-282b19b68df2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:16.216522 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f7e21e3-d528-4ab9-96db-282b19b68df2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:16.216980 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f7e21e3-d528-4ab9-96db-282b19b68df2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:16.217400 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f7e21e3-d528-4ab9-96db-282b19b68df2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:16.353538 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8f7e21e3-d528-4ab9-96db-282b19b68df2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:16.362386 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8f7e21e3-d528-4ab9-96db-282b19b68df2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:16.363878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8f7e21e3-d528-4ab9-96db-282b19b68df2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:16.365067 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8f7e21e3-d528-4ab9-96db-282b19b68df2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1752 microversion: 2.20 time: 0.162230 Aug 24 16:53:16.365623 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 259/518] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:16 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:17.389056 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f9115413-5006-4a7c-bcec-0fe3c83130d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:17.389671 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f9115413-5006-4a7c-bcec-0fe3c83130d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:17.391919 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:17.396895 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f9115413-5006-4a7c-bcec-0fe3c83130d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:17.397378 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f9115413-5006-4a7c-bcec-0fe3c83130d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:17.397822 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f9115413-5006-4a7c-bcec-0fe3c83130d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:17.398504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f9115413-5006-4a7c-bcec-0fe3c83130d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:17.398956 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f9115413-5006-4a7c-bcec-0fe3c83130d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:17.399379 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f9115413-5006-4a7c-bcec-0fe3c83130d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:17.532228 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f9115413-5006-4a7c-bcec-0fe3c83130d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:17.541828 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f9115413-5006-4a7c-bcec-0fe3c83130d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:17.543367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f9115413-5006-4a7c-bcec-0fe3c83130d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:17.544579 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f9115413-5006-4a7c-bcec-0fe3c83130d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.159796 Aug 24 16:53:17.545130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 260/519] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:17 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:18.568088 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c1cbb77b-5a57-4761-aedb-ae506eac93cd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:18.571310 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c1cbb77b-5a57-4761-aedb-ae506eac93cd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:18.575058 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c1cbb77b-5a57-4761-aedb-ae506eac93cd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:18.575535 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c1cbb77b-5a57-4761-aedb-ae506eac93cd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:18.575966 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c1cbb77b-5a57-4761-aedb-ae506eac93cd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:18.577767 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c1cbb77b-5a57-4761-aedb-ae506eac93cd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:18.577767 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c1cbb77b-5a57-4761-aedb-ae506eac93cd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:18.577767 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c1cbb77b-5a57-4761-aedb-ae506eac93cd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:18.707295 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c1cbb77b-5a57-4761-aedb-ae506eac93cd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:18.715980 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c1cbb77b-5a57-4761-aedb-ae506eac93cd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:18.717514 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c1cbb77b-5a57-4761-aedb-ae506eac93cd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:18.718669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c1cbb77b-5a57-4761-aedb-ae506eac93cd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.155467 Aug 24 16:53:18.719227 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 260/520] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:18 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:19.742483 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6419d382-a93e-4d37-8a0f-50023eda9cab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:19.743134 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6419d382-a93e-4d37-8a0f-50023eda9cab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:19.749909 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6419d382-a93e-4d37-8a0f-50023eda9cab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:19.750389 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6419d382-a93e-4d37-8a0f-50023eda9cab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:19.750825 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6419d382-a93e-4d37-8a0f-50023eda9cab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:19.751779 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6419d382-a93e-4d37-8a0f-50023eda9cab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:19.752231 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6419d382-a93e-4d37-8a0f-50023eda9cab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:19.752681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6419d382-a93e-4d37-8a0f-50023eda9cab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:19.890983 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6419d382-a93e-4d37-8a0f-50023eda9cab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:19.899747 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6419d382-a93e-4d37-8a0f-50023eda9cab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:19.901796 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6419d382-a93e-4d37-8a0f-50023eda9cab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:19.902955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6419d382-a93e-4d37-8a0f-50023eda9cab tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.164541 Aug 24 16:53:19.903699 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 261/521] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:19 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:20.926544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-42aff2ff-edc4-4537-bdc4-171db30e49b1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:20.927172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-42aff2ff-edc4-4537-bdc4-171db30e49b1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:20.929650 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=41 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:20.935190 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-42aff2ff-edc4-4537-bdc4-171db30e49b1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:20.940815 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-42aff2ff-edc4-4537-bdc4-171db30e49b1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:20.940815 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-42aff2ff-edc4-4537-bdc4-171db30e49b1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:20.940815 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-42aff2ff-edc4-4537-bdc4-171db30e49b1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:20.940815 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-42aff2ff-edc4-4537-bdc4-171db30e49b1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:20.941204 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-42aff2ff-edc4-4537-bdc4-171db30e49b1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:21.078391 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-42aff2ff-edc4-4537-bdc4-171db30e49b1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:21.087694 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-42aff2ff-edc4-4537-bdc4-171db30e49b1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:21.089817 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-42aff2ff-edc4-4537-bdc4-171db30e49b1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:21.092478 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-42aff2ff-edc4-4537-bdc4-171db30e49b1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.168958 Aug 24 16:53:21.093052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 261/522] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:20 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:22.115055 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9bf203f1-ff9b-4eb4-b91a-26f8ed67c268 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:22.115726 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9bf203f1-ff9b-4eb4-b91a-26f8ed67c268 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:22.122256 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bf203f1-ff9b-4eb4-b91a-26f8ed67c268 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:22.122738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bf203f1-ff9b-4eb4-b91a-26f8ed67c268 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:22.123170 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bf203f1-ff9b-4eb4-b91a-26f8ed67c268 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:22.123890 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bf203f1-ff9b-4eb4-b91a-26f8ed67c268 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:22.124355 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bf203f1-ff9b-4eb4-b91a-26f8ed67c268 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:22.124888 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bf203f1-ff9b-4eb4-b91a-26f8ed67c268 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:22.258431 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9bf203f1-ff9b-4eb4-b91a-26f8ed67c268 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:22.267972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9bf203f1-ff9b-4eb4-b91a-26f8ed67c268 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:22.269470 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9bf203f1-ff9b-4eb4-b91a-26f8ed67c268 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:22.270619 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9bf203f1-ff9b-4eb4-b91a-26f8ed67c268 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.159451 Aug 24 16:53:22.271166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 262/523] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:22 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:23.293440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-af42b804-7308-4719-a60b-5e1cae2b3fcc tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:23.294049 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-af42b804-7308-4719-a60b-5e1cae2b3fcc tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:23.301436 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-af42b804-7308-4719-a60b-5e1cae2b3fcc tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:23.301926 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-af42b804-7308-4719-a60b-5e1cae2b3fcc tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:23.302419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-af42b804-7308-4719-a60b-5e1cae2b3fcc tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:23.303128 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-af42b804-7308-4719-a60b-5e1cae2b3fcc tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:23.303585 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-af42b804-7308-4719-a60b-5e1cae2b3fcc tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:23.304013 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-af42b804-7308-4719-a60b-5e1cae2b3fcc tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:23.443424 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-af42b804-7308-4719-a60b-5e1cae2b3fcc tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:23.447022 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:23.452694 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-af42b804-7308-4719-a60b-5e1cae2b3fcc tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:23.454184 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-af42b804-7308-4719-a60b-5e1cae2b3fcc tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:23.455415 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-af42b804-7308-4719-a60b-5e1cae2b3fcc tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.166293 Aug 24 16:53:23.455970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 262/524] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:23 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:24.478538 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-61a43b18-5d03-413a-bf5c-c196be3f641c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:24.479129 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-61a43b18-5d03-413a-bf5c-c196be3f641c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:24.485799 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61a43b18-5d03-413a-bf5c-c196be3f641c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:24.486318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61a43b18-5d03-413a-bf5c-c196be3f641c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:24.486755 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61a43b18-5d03-413a-bf5c-c196be3f641c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:24.487450 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61a43b18-5d03-413a-bf5c-c196be3f641c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:24.487951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61a43b18-5d03-413a-bf5c-c196be3f641c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:24.488367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61a43b18-5d03-413a-bf5c-c196be3f641c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:24.623183 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-61a43b18-5d03-413a-bf5c-c196be3f641c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:24.632344 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-61a43b18-5d03-413a-bf5c-c196be3f641c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:24.634056 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-61a43b18-5d03-413a-bf5c-c196be3f641c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:24.635263 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-61a43b18-5d03-413a-bf5c-c196be3f641c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.160674 Aug 24 16:53:24.636444 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 263/525] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:24 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:25.660933 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4ce93036-4a79-4c0a-b4a8-4fe2952e21b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:25.661594 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4ce93036-4a79-4c0a-b4a8-4fe2952e21b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:25.669555 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ce93036-4a79-4c0a-b4a8-4fe2952e21b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:25.670043 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ce93036-4a79-4c0a-b4a8-4fe2952e21b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:25.670484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ce93036-4a79-4c0a-b4a8-4fe2952e21b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:25.671245 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ce93036-4a79-4c0a-b4a8-4fe2952e21b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:25.671710 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ce93036-4a79-4c0a-b4a8-4fe2952e21b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:25.672141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ce93036-4a79-4c0a-b4a8-4fe2952e21b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:25.810051 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4ce93036-4a79-4c0a-b4a8-4fe2952e21b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:25.819206 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4ce93036-4a79-4c0a-b4a8-4fe2952e21b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:25.821518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4ce93036-4a79-4c0a-b4a8-4fe2952e21b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:25.823112 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4ce93036-4a79-4c0a-b4a8-4fe2952e21b9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.166928 Aug 24 16:53:25.824203 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 263/526] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:25 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:26.846133 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8459dc26-4263-47b0-ac81-473df3bf5fc0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:26.846750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8459dc26-4263-47b0-ac81-473df3bf5fc0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:26.853062 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8459dc26-4263-47b0-ac81-473df3bf5fc0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:26.853543 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8459dc26-4263-47b0-ac81-473df3bf5fc0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:26.853968 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8459dc26-4263-47b0-ac81-473df3bf5fc0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:26.855431 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8459dc26-4263-47b0-ac81-473df3bf5fc0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:26.855882 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8459dc26-4263-47b0-ac81-473df3bf5fc0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:26.856301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8459dc26-4263-47b0-ac81-473df3bf5fc0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:26.988552 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8459dc26-4263-47b0-ac81-473df3bf5fc0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:26.997113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8459dc26-4263-47b0-ac81-473df3bf5fc0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:26.998587 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8459dc26-4263-47b0-ac81-473df3bf5fc0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:26.999726 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8459dc26-4263-47b0-ac81-473df3bf5fc0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.157860 Aug 24 16:53:27.000277 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 264/527] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:26 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:28.025657 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ee5808a3-6e08-4421-b8c2-eb13bea89b59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:28.026351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ee5808a3-6e08-4421-b8c2-eb13bea89b59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:28.032761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee5808a3-6e08-4421-b8c2-eb13bea89b59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:28.033241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee5808a3-6e08-4421-b8c2-eb13bea89b59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:28.033672 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee5808a3-6e08-4421-b8c2-eb13bea89b59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:28.034355 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee5808a3-6e08-4421-b8c2-eb13bea89b59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:28.034807 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee5808a3-6e08-4421-b8c2-eb13bea89b59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:28.035226 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ee5808a3-6e08-4421-b8c2-eb13bea89b59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:28.165370 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ee5808a3-6e08-4421-b8c2-eb13bea89b59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:28.175434 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ee5808a3-6e08-4421-b8c2-eb13bea89b59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:28.176960 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ee5808a3-6e08-4421-b8c2-eb13bea89b59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:28.178179 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ee5808a3-6e08-4421-b8c2-eb13bea89b59 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.156744 Aug 24 16:53:28.178933 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 264/528] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:28 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:29.201807 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-75d898a3-758c-4186-a04f-ebbfaaf64151 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:29.202444 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-75d898a3-758c-4186-a04f-ebbfaaf64151 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:29.209134 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-75d898a3-758c-4186-a04f-ebbfaaf64151 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:29.209640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-75d898a3-758c-4186-a04f-ebbfaaf64151 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:29.210104 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-75d898a3-758c-4186-a04f-ebbfaaf64151 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:29.210808 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-75d898a3-758c-4186-a04f-ebbfaaf64151 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:29.211262 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-75d898a3-758c-4186-a04f-ebbfaaf64151 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:29.211688 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-75d898a3-758c-4186-a04f-ebbfaaf64151 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:29.352949 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-75d898a3-758c-4186-a04f-ebbfaaf64151 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:29.362733 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-75d898a3-758c-4186-a04f-ebbfaaf64151 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:29.364246 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-75d898a3-758c-4186-a04f-ebbfaaf64151 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:29.365479 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-75d898a3-758c-4186-a04f-ebbfaaf64151 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.168237 Aug 24 16:53:29.366241 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 265/529] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:29 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:30.390207 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-01ebefaa-4741-4fd5-9108-b69952ced741 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:30.390816 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-01ebefaa-4741-4fd5-9108-b69952ced741 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:30.397231 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-01ebefaa-4741-4fd5-9108-b69952ced741 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:30.397727 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-01ebefaa-4741-4fd5-9108-b69952ced741 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:30.398149 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-01ebefaa-4741-4fd5-9108-b69952ced741 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:30.398844 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-01ebefaa-4741-4fd5-9108-b69952ced741 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:30.399298 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-01ebefaa-4741-4fd5-9108-b69952ced741 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:30.399722 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-01ebefaa-4741-4fd5-9108-b69952ced741 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:30.534549 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-01ebefaa-4741-4fd5-9108-b69952ced741 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:30.543590 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-01ebefaa-4741-4fd5-9108-b69952ced741 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:30.545121 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-01ebefaa-4741-4fd5-9108-b69952ced741 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:30.546282 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-01ebefaa-4741-4fd5-9108-b69952ced741 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.159992 Aug 24 16:53:30.546838 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 265/530] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:30 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:31.569519 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-43cb10e2-3f6a-4d38-8883-3b9124985b81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:31.570126 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-43cb10e2-3f6a-4d38-8883-3b9124985b81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:31.576561 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43cb10e2-3f6a-4d38-8883-3b9124985b81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:31.577033 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43cb10e2-3f6a-4d38-8883-3b9124985b81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:31.577462 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43cb10e2-3f6a-4d38-8883-3b9124985b81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:31.578141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43cb10e2-3f6a-4d38-8883-3b9124985b81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:31.578586 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43cb10e2-3f6a-4d38-8883-3b9124985b81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:31.578998 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43cb10e2-3f6a-4d38-8883-3b9124985b81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:31.706318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-43cb10e2-3f6a-4d38-8883-3b9124985b81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:31.715337 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-43cb10e2-3f6a-4d38-8883-3b9124985b81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:31.716843 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-43cb10e2-3f6a-4d38-8883-3b9124985b81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:31.717984 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-43cb10e2-3f6a-4d38-8883-3b9124985b81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.152345 Aug 24 16:53:31.718537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 266/531] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:31 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:32.740836 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-96ed8254-72c8-4341-9232-1c02be02c450 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:32.741468 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-96ed8254-72c8-4341-9232-1c02be02c450 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:32.748460 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-96ed8254-72c8-4341-9232-1c02be02c450 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:32.748945 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-96ed8254-72c8-4341-9232-1c02be02c450 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:32.749377 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-96ed8254-72c8-4341-9232-1c02be02c450 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:32.750061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-96ed8254-72c8-4341-9232-1c02be02c450 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:32.750516 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-96ed8254-72c8-4341-9232-1c02be02c450 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:32.750940 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-96ed8254-72c8-4341-9232-1c02be02c450 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:32.878335 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-96ed8254-72c8-4341-9232-1c02be02c450 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:32.886920 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-96ed8254-72c8-4341-9232-1c02be02c450 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:32.890267 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-96ed8254-72c8-4341-9232-1c02be02c450 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:32.890267 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-96ed8254-72c8-4341-9232-1c02be02c450 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.152601 Aug 24 16:53:32.890267 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 266/532] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:32 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:33.912960 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-475389b2-f4f3-4442-8d4b-a8e648f5500a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:33.913646 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-475389b2-f4f3-4442-8d4b-a8e648f5500a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:33.920534 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-475389b2-f4f3-4442-8d4b-a8e648f5500a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:33.921049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-475389b2-f4f3-4442-8d4b-a8e648f5500a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:33.921487 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-475389b2-f4f3-4442-8d4b-a8e648f5500a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:33.922177 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-475389b2-f4f3-4442-8d4b-a8e648f5500a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:33.922638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-475389b2-f4f3-4442-8d4b-a8e648f5500a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:33.923059 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-475389b2-f4f3-4442-8d4b-a8e648f5500a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:34.047963 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-475389b2-f4f3-4442-8d4b-a8e648f5500a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:34.056553 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-475389b2-f4f3-4442-8d4b-a8e648f5500a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:34.058067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-475389b2-f4f3-4442-8d4b-a8e648f5500a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:34.059226 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-475389b2-f4f3-4442-8d4b-a8e648f5500a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.150193 Aug 24 16:53:34.059783 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 267/533] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:33 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:35.081610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-bd480d45-8dd9-46ff-abcb-f6c91be612a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:35.082215 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-bd480d45-8dd9-46ff-abcb-f6c91be612a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:35.089590 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bd480d45-8dd9-46ff-abcb-f6c91be612a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:35.090238 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bd480d45-8dd9-46ff-abcb-f6c91be612a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:35.090864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bd480d45-8dd9-46ff-abcb-f6c91be612a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:35.091809 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bd480d45-8dd9-46ff-abcb-f6c91be612a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:35.092336 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bd480d45-8dd9-46ff-abcb-f6c91be612a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:35.092784 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bd480d45-8dd9-46ff-abcb-f6c91be612a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:35.228016 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-bd480d45-8dd9-46ff-abcb-f6c91be612a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:35.237575 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-bd480d45-8dd9-46ff-abcb-f6c91be612a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:35.239122 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-bd480d45-8dd9-46ff-abcb-f6c91be612a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:35.240363 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-bd480d45-8dd9-46ff-abcb-f6c91be612a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.162716 Aug 24 16:53:35.248364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 267/534] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:35 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:35.316800 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-56ae1614-d6aa-4497-9a96-e6c0af0deaf5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8729176a-3c8d-4f1b-bf15-1fd9d8be916f"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:35.319192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-56ae1614-d6aa-4497-9a96-e6c0af0deaf5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:35.325810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-56ae1614-d6aa-4497-9a96-e6c0af0deaf5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:35.326284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-56ae1614-d6aa-4497-9a96-e6c0af0deaf5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:35.326717 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-56ae1614-d6aa-4497-9a96-e6c0af0deaf5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:35.327397 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-56ae1614-d6aa-4497-9a96-e6c0af0deaf5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:35.327848 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-56ae1614-d6aa-4497-9a96-e6c0af0deaf5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:35.328270 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-56ae1614-d6aa-4497-9a96-e6c0af0deaf5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:36.009119 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-56ae1614-d6aa-4497-9a96-e6c0af0deaf5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "POST /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.800940 Aug 24 16:53:36.009761 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 268/535] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 16:53:35 2022] POST /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-volume_attachments => generated 194 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:53:36.264780 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-978255f0-7651-4d5f-a8a9-4fb15de84a0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:36.265410 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-978255f0-7651-4d5f-a8a9-4fb15de84a0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:36.271777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-978255f0-7651-4d5f-a8a9-4fb15de84a0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:36.272258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-978255f0-7651-4d5f-a8a9-4fb15de84a0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:36.272725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-978255f0-7651-4d5f-a8a9-4fb15de84a0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:36.273413 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-978255f0-7651-4d5f-a8a9-4fb15de84a0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:36.273865 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-978255f0-7651-4d5f-a8a9-4fb15de84a0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:36.274288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-978255f0-7651-4d5f-a8a9-4fb15de84a0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:36.401471 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-978255f0-7651-4d5f-a8a9-4fb15de84a0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:36.409927 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-978255f0-7651-4d5f-a8a9-4fb15de84a0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:36.411396 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-978255f0-7651-4d5f-a8a9-4fb15de84a0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:36.412566 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-978255f0-7651-4d5f-a8a9-4fb15de84a0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.152212 Aug 24 16:53:36.413122 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 268/536] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:36 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:37.436375 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-932bfd24-d07b-472c-8528-2b04a13d7189 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:37.437093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-932bfd24-d07b-472c-8528-2b04a13d7189 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:37.443166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-932bfd24-d07b-472c-8528-2b04a13d7189 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:37.443641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-932bfd24-d07b-472c-8528-2b04a13d7189 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:37.444066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-932bfd24-d07b-472c-8528-2b04a13d7189 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:37.444771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-932bfd24-d07b-472c-8528-2b04a13d7189 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:37.445215 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-932bfd24-d07b-472c-8528-2b04a13d7189 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:37.445632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-932bfd24-d07b-472c-8528-2b04a13d7189 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:37.579150 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-932bfd24-d07b-472c-8528-2b04a13d7189 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:37.587785 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-932bfd24-d07b-472c-8528-2b04a13d7189 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:37.589734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-932bfd24-d07b-472c-8528-2b04a13d7189 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:37.590891 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-932bfd24-d07b-472c-8528-2b04a13d7189 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.159253 Aug 24 16:53:37.591447 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 269/537] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:37 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:38.614372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0bf666de-ecf1-4e3e-8ab6-7f1f685719cb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:38.614989 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0bf666de-ecf1-4e3e-8ab6-7f1f685719cb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:38.621310 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0bf666de-ecf1-4e3e-8ab6-7f1f685719cb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:38.621794 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0bf666de-ecf1-4e3e-8ab6-7f1f685719cb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:38.622232 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0bf666de-ecf1-4e3e-8ab6-7f1f685719cb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:38.622922 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0bf666de-ecf1-4e3e-8ab6-7f1f685719cb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:38.623425 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0bf666de-ecf1-4e3e-8ab6-7f1f685719cb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:38.623852 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0bf666de-ecf1-4e3e-8ab6-7f1f685719cb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:38.748172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0bf666de-ecf1-4e3e-8ab6-7f1f685719cb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:38.757284 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0bf666de-ecf1-4e3e-8ab6-7f1f685719cb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:38.758775 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0bf666de-ecf1-4e3e-8ab6-7f1f685719cb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:38.759954 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0bf666de-ecf1-4e3e-8ab6-7f1f685719cb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.149452 Aug 24 16:53:38.761058 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 269/538] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:38 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:39.783150 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b2e4eb6e-3583-45a5-9842-1f5d3fb36e6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:39.783692 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b2e4eb6e-3583-45a5-9842-1f5d3fb36e6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:39.790049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e4eb6e-3583-45a5-9842-1f5d3fb36e6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:39.790530 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e4eb6e-3583-45a5-9842-1f5d3fb36e6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:39.790988 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e4eb6e-3583-45a5-9842-1f5d3fb36e6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:39.791683 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e4eb6e-3583-45a5-9842-1f5d3fb36e6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:39.792132 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e4eb6e-3583-45a5-9842-1f5d3fb36e6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:39.792581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e4eb6e-3583-45a5-9842-1f5d3fb36e6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:39.928205 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2e4eb6e-3583-45a5-9842-1f5d3fb36e6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:39.938173 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2e4eb6e-3583-45a5-9842-1f5d3fb36e6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:39.939719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2e4eb6e-3583-45a5-9842-1f5d3fb36e6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:39.940951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b2e4eb6e-3583-45a5-9842-1f5d3fb36e6b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.161756 Aug 24 16:53:39.941721 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 270/539] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:39 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:40.964339 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a7814f4e-c665-4cc3-99d9-995295412368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:40.964962 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a7814f4e-c665-4cc3-99d9-995295412368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:40.971570 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a7814f4e-c665-4cc3-99d9-995295412368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:40.972052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a7814f4e-c665-4cc3-99d9-995295412368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:40.972521 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a7814f4e-c665-4cc3-99d9-995295412368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:40.973214 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a7814f4e-c665-4cc3-99d9-995295412368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:40.973667 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a7814f4e-c665-4cc3-99d9-995295412368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:40.974092 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a7814f4e-c665-4cc3-99d9-995295412368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:41.102545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a7814f4e-c665-4cc3-99d9-995295412368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:41.111047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a7814f4e-c665-4cc3-99d9-995295412368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:41.112564 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a7814f4e-c665-4cc3-99d9-995295412368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:41.113718 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a7814f4e-c665-4cc3-99d9-995295412368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.154366 Aug 24 16:53:41.114282 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 270/540] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:40 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:42.136576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ab7efca9-7e8e-4763-890c-d8f0b4260637 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:42.137190 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ab7efca9-7e8e-4763-890c-d8f0b4260637 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:42.143599 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ab7efca9-7e8e-4763-890c-d8f0b4260637 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:42.144078 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ab7efca9-7e8e-4763-890c-d8f0b4260637 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:42.144544 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ab7efca9-7e8e-4763-890c-d8f0b4260637 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:42.145230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ab7efca9-7e8e-4763-890c-d8f0b4260637 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:42.145680 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ab7efca9-7e8e-4763-890c-d8f0b4260637 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:42.146100 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ab7efca9-7e8e-4763-890c-d8f0b4260637 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:42.271278 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ab7efca9-7e8e-4763-890c-d8f0b4260637 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:42.280448 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ab7efca9-7e8e-4763-890c-d8f0b4260637 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:42.281945 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ab7efca9-7e8e-4763-890c-d8f0b4260637 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:42.283093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ab7efca9-7e8e-4763-890c-d8f0b4260637 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.150491 Aug 24 16:53:42.283647 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 271/541] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:42 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:43.305969 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1d30bab2-1497-4495-85af-143267aee3d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:43.306579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1d30bab2-1497-4495-85af-143267aee3d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:43.313640 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d30bab2-1497-4495-85af-143267aee3d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:43.314123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d30bab2-1497-4495-85af-143267aee3d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:43.314557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d30bab2-1497-4495-85af-143267aee3d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:43.315246 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d30bab2-1497-4495-85af-143267aee3d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:43.315701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d30bab2-1497-4495-85af-143267aee3d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:43.316129 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d30bab2-1497-4495-85af-143267aee3d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:43.452813 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1d30bab2-1497-4495-85af-143267aee3d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:43.468579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1d30bab2-1497-4495-85af-143267aee3d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:43.469533 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1d30bab2-1497-4495-85af-143267aee3d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:43.470837 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1d30bab2-1497-4495-85af-143267aee3d6 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.168739 Aug 24 16:53:43.471625 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 271/542] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:43 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:44.494065 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b2256fef-6dcb-4fba-bbba-ef215936f5c7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:44.494667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b2256fef-6dcb-4fba-bbba-ef215936f5c7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:44.501252 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2256fef-6dcb-4fba-bbba-ef215936f5c7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:44.501979 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2256fef-6dcb-4fba-bbba-ef215936f5c7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:44.502402 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2256fef-6dcb-4fba-bbba-ef215936f5c7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:44.503081 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2256fef-6dcb-4fba-bbba-ef215936f5c7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:44.503524 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2256fef-6dcb-4fba-bbba-ef215936f5c7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:44.503937 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2256fef-6dcb-4fba-bbba-ef215936f5c7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:44.607152 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-559ecbca-df3c-4af1-bdda-22800a201b60 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:44.609633 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-559ecbca-df3c-4af1-bdda-22800a201b60 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:44.616051 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-559ecbca-df3c-4af1-bdda-22800a201b60 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:44.616582 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-559ecbca-df3c-4af1-bdda-22800a201b60 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:44.617029 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-559ecbca-df3c-4af1-bdda-22800a201b60 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:44.617727 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-559ecbca-df3c-4af1-bdda-22800a201b60 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:44.618182 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-559ecbca-df3c-4af1-bdda-22800a201b60 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:44.618607 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-559ecbca-df3c-4af1-bdda-22800a201b60 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:44.642107 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-559ecbca-df3c-4af1-bdda-22800a201b60 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lazy-loading 'flavor' on Instance uuid 84ecc526-a083-4f47-ac70-0b06d5b66158 {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:53:44.652843 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2256fef-6dcb-4fba-bbba-ef215936f5c7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:44.662017 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2256fef-6dcb-4fba-bbba-ef215936f5c7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:44.663505 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2256fef-6dcb-4fba-bbba-ef215936f5c7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:44.664678 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b2256fef-6dcb-4fba-bbba-ef215936f5c7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.174515 Aug 24 16:53:44.665223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 272/543] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:44 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:44.963187 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-559ecbca-df3c-4af1-bdda-22800a201b60 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "POST /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/action" status: 200 len: 32 microversion: 2.1 time: 0.360469 Aug 24 16:53:44.963801 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 272/544] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 16:53:44 2022] POST /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/action => generated 32 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 16:53:44.973829 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4a19e1a7-c364-4b78-92d5-95c8922a514e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:44.974492 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4a19e1a7-c364-4b78-92d5-95c8922a514e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:44.980188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a19e1a7-c364-4b78-92d5-95c8922a514e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:44.981408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a19e1a7-c364-4b78-92d5-95c8922a514e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:44.981841 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a19e1a7-c364-4b78-92d5-95c8922a514e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:44.982525 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a19e1a7-c364-4b78-92d5-95c8922a514e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:44.982972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a19e1a7-c364-4b78-92d5-95c8922a514e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:44.983389 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a19e1a7-c364-4b78-92d5-95c8922a514e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:45.118459 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4a19e1a7-c364-4b78-92d5-95c8922a514e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:45.128815 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4a19e1a7-c364-4b78-92d5-95c8922a514e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.158821 Aug 24 16:53:45.130018 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 273/545] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:44 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:45.688750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a18415ac-cb19-4efa-92a4-759bd3f2cb2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:45.689507 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a18415ac-cb19-4efa-92a4-759bd3f2cb2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:45.695917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a18415ac-cb19-4efa-92a4-759bd3f2cb2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:45.696412 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a18415ac-cb19-4efa-92a4-759bd3f2cb2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:45.696873 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a18415ac-cb19-4efa-92a4-759bd3f2cb2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:45.697558 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a18415ac-cb19-4efa-92a4-759bd3f2cb2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:45.698012 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a18415ac-cb19-4efa-92a4-759bd3f2cb2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:45.698432 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a18415ac-cb19-4efa-92a4-759bd3f2cb2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:45.827450 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a18415ac-cb19-4efa-92a4-759bd3f2cb2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:45.836092 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a18415ac-cb19-4efa-92a4-759bd3f2cb2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:45.838729 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a18415ac-cb19-4efa-92a4-759bd3f2cb2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:45.838882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a18415ac-cb19-4efa-92a4-759bd3f2cb2f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.155571 Aug 24 16:53:45.839429 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 273/546] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:45 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:46.151046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4d3f5941-c004-4351-8597-04fdd655e094 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:46.151664 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4d3f5941-c004-4351-8597-04fdd655e094 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:46.158167 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4d3f5941-c004-4351-8597-04fdd655e094 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:46.158652 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4d3f5941-c004-4351-8597-04fdd655e094 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:46.159086 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4d3f5941-c004-4351-8597-04fdd655e094 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:46.159781 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4d3f5941-c004-4351-8597-04fdd655e094 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:46.160255 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4d3f5941-c004-4351-8597-04fdd655e094 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:46.160690 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4d3f5941-c004-4351-8597-04fdd655e094 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:46.289777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4d3f5941-c004-4351-8597-04fdd655e094 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:46.294000 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:46.299027 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4d3f5941-c004-4351-8597-04fdd655e094 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.151819 Aug 24 16:53:46.299593 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 274/547] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:46 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:46.529204 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-e4562399-28ff-4da4-8d56-53ca42e15371 req-5881eeeb-4aa0-4f67-8729-d4823d7f2075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2cca9b-5df9-43a4-9791-633eab746eeb", "name": "network-vif-plugged", "status": "completed", "tag": "de8a2ec3-3c1d-4c19-9833-a7a754e2b815"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:46.538397 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-e4562399-28ff-4da4-8d56-53ca42e15371 req-5881eeeb-4aa0-4f67-8729-d4823d7f2075 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:46.538877 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-e4562399-28ff-4da4-8d56-53ca42e15371 req-5881eeeb-4aa0-4f67-8729-d4823d7f2075 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:46.539306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-e4562399-28ff-4da4-8d56-53ca42e15371 req-5881eeeb-4aa0-4f67-8729-d4823d7f2075 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:46.553447 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-e4562399-28ff-4da4-8d56-53ca42e15371 req-5881eeeb-4aa0-4f67-8729-d4823d7f2075 service nova] Creating event network-vif-plugged:de8a2ec3-3c1d-4c19-9833-a7a754e2b815 for instance 6d2cca9b-5df9-43a4-9791-633eab746eeb on hv-cinder-85220 Aug 24 16:53:46.558762 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-e4562399-28ff-4da4-8d56-53ca42e15371 req-5881eeeb-4aa0-4f67-8729-d4823d7f2075 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033778 Aug 24 16:53:46.559344 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 274/548] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:46.862130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-59550051-fedf-439b-90e6-2017415a25bd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:46.862722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-59550051-fedf-439b-90e6-2017415a25bd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:46.869330 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59550051-fedf-439b-90e6-2017415a25bd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:46.869809 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59550051-fedf-439b-90e6-2017415a25bd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:46.870247 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59550051-fedf-439b-90e6-2017415a25bd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:46.870966 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59550051-fedf-439b-90e6-2017415a25bd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:46.871391 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59550051-fedf-439b-90e6-2017415a25bd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:46.871815 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59550051-fedf-439b-90e6-2017415a25bd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:47.000556 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-59550051-fedf-439b-90e6-2017415a25bd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:47.009260 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-59550051-fedf-439b-90e6-2017415a25bd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:47.010736 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-59550051-fedf-439b-90e6-2017415a25bd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:47.012462 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-59550051-fedf-439b-90e6-2017415a25bd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.153743 Aug 24 16:53:47.013019 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 275/549] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:46 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:47.320663 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4935653c-ec9d-4c0b-a14d-dca697444e11 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:47.321283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4935653c-ec9d-4c0b-a14d-dca697444e11 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:47.329023 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4935653c-ec9d-4c0b-a14d-dca697444e11 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:47.329976 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4935653c-ec9d-4c0b-a14d-dca697444e11 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:47.330630 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4935653c-ec9d-4c0b-a14d-dca697444e11 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:47.331539 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4935653c-ec9d-4c0b-a14d-dca697444e11 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:47.332186 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4935653c-ec9d-4c0b-a14d-dca697444e11 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:47.332838 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4935653c-ec9d-4c0b-a14d-dca697444e11 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:47.461959 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4935653c-ec9d-4c0b-a14d-dca697444e11 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:47.470340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4935653c-ec9d-4c0b-a14d-dca697444e11 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.153966 Aug 24 16:53:47.470907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 275/550] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:47 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:48.035179 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-234d7566-5b9a-4e42-9f66-ec61f3003623 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:48.035798 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-234d7566-5b9a-4e42-9f66-ec61f3003623 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:48.038120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=32 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:48.042812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-234d7566-5b9a-4e42-9f66-ec61f3003623 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:48.048323 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-234d7566-5b9a-4e42-9f66-ec61f3003623 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:48.048323 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-234d7566-5b9a-4e42-9f66-ec61f3003623 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:48.048323 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-234d7566-5b9a-4e42-9f66-ec61f3003623 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:48.048323 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-234d7566-5b9a-4e42-9f66-ec61f3003623 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:48.048730 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-234d7566-5b9a-4e42-9f66-ec61f3003623 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:48.174556 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-234d7566-5b9a-4e42-9f66-ec61f3003623 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:48.183121 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-234d7566-5b9a-4e42-9f66-ec61f3003623 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:48.184657 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-234d7566-5b9a-4e42-9f66-ec61f3003623 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:48.185808 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-234d7566-5b9a-4e42-9f66-ec61f3003623 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.154560 Aug 24 16:53:48.186366 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 276/551] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:48 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:48.491696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-227d9b9a-d124-400c-8a48-c50fdf9a5d87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:48.492285 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-227d9b9a-d124-400c-8a48-c50fdf9a5d87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:48.499253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-227d9b9a-d124-400c-8a48-c50fdf9a5d87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:48.499738 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-227d9b9a-d124-400c-8a48-c50fdf9a5d87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:48.500175 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-227d9b9a-d124-400c-8a48-c50fdf9a5d87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:48.500882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-227d9b9a-d124-400c-8a48-c50fdf9a5d87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:48.501335 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-227d9b9a-d124-400c-8a48-c50fdf9a5d87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:48.502013 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-227d9b9a-d124-400c-8a48-c50fdf9a5d87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:48.627475 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-227d9b9a-d124-400c-8a48-c50fdf9a5d87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:48.635525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-227d9b9a-d124-400c-8a48-c50fdf9a5d87 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.147721 Aug 24 16:53:48.636079 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 276/552] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:48 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:49.208998 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6d334a82-e77c-44eb-bf5a-7ca8cc247a1b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:49.209609 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6d334a82-e77c-44eb-bf5a-7ca8cc247a1b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:49.216002 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d334a82-e77c-44eb-bf5a-7ca8cc247a1b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:49.220318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d334a82-e77c-44eb-bf5a-7ca8cc247a1b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:49.220318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d334a82-e77c-44eb-bf5a-7ca8cc247a1b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:49.220318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d334a82-e77c-44eb-bf5a-7ca8cc247a1b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:49.220318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d334a82-e77c-44eb-bf5a-7ca8cc247a1b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:49.220835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d334a82-e77c-44eb-bf5a-7ca8cc247a1b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:49.348701 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6d334a82-e77c-44eb-bf5a-7ca8cc247a1b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:49.357968 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6d334a82-e77c-44eb-bf5a-7ca8cc247a1b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:49.359486 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6d334a82-e77c-44eb-bf5a-7ca8cc247a1b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:49.360721 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6d334a82-e77c-44eb-bf5a-7ca8cc247a1b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.155602 Aug 24 16:53:49.361283 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 277/553] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:49 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:49.657152 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-89b1c3f1-2c02-4625-aa50-d21e8bb815c6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:49.657769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-89b1c3f1-2c02-4625-aa50-d21e8bb815c6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:49.664191 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89b1c3f1-2c02-4625-aa50-d21e8bb815c6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:49.664723 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89b1c3f1-2c02-4625-aa50-d21e8bb815c6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:49.665162 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89b1c3f1-2c02-4625-aa50-d21e8bb815c6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:49.665904 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89b1c3f1-2c02-4625-aa50-d21e8bb815c6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:49.666362 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89b1c3f1-2c02-4625-aa50-d21e8bb815c6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:49.666788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89b1c3f1-2c02-4625-aa50-d21e8bb815c6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:49.790974 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-89b1c3f1-2c02-4625-aa50-d21e8bb815c6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:49.799172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-89b1c3f1-2c02-4625-aa50-d21e8bb815c6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.146631 Aug 24 16:53:49.799741 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 277/554] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:49 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:50.383184 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3baddf9a-f367-4235-b849-142764e5b560 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:50.383795 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3baddf9a-f367-4235-b849-142764e5b560 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:50.390916 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3baddf9a-f367-4235-b849-142764e5b560 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:50.391400 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3baddf9a-f367-4235-b849-142764e5b560 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:50.391828 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3baddf9a-f367-4235-b849-142764e5b560 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:50.392551 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3baddf9a-f367-4235-b849-142764e5b560 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:50.393009 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3baddf9a-f367-4235-b849-142764e5b560 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:50.393430 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3baddf9a-f367-4235-b849-142764e5b560 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:50.522495 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3baddf9a-f367-4235-b849-142764e5b560 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:50.531087 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3baddf9a-f367-4235-b849-142764e5b560 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:50.532622 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3baddf9a-f367-4235-b849-142764e5b560 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:50.535509 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3baddf9a-f367-4235-b849-142764e5b560 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.154446 Aug 24 16:53:50.535509 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 278/555] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:50 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:50.819690 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-842c0e3a-5270-40b6-915e-020978834790 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:50.820289 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-842c0e3a-5270-40b6-915e-020978834790 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:50.826291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-842c0e3a-5270-40b6-915e-020978834790 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:50.826767 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-842c0e3a-5270-40b6-915e-020978834790 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:50.827203 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-842c0e3a-5270-40b6-915e-020978834790 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:50.827887 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-842c0e3a-5270-40b6-915e-020978834790 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:50.828340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-842c0e3a-5270-40b6-915e-020978834790 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:50.828789 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-842c0e3a-5270-40b6-915e-020978834790 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:50.834423 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:50.965558 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-842c0e3a-5270-40b6-915e-020978834790 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:50.976222 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-842c0e3a-5270-40b6-915e-020978834790 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.160313 Aug 24 16:53:50.976892 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 278/556] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:50 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:51.558477 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3764febd-07a1-4506-adfa-93b2cbcff4ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:51.559179 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3764febd-07a1-4506-adfa-93b2cbcff4ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:51.566105 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3764febd-07a1-4506-adfa-93b2cbcff4ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:51.566589 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3764febd-07a1-4506-adfa-93b2cbcff4ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:51.567019 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3764febd-07a1-4506-adfa-93b2cbcff4ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:51.567710 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3764febd-07a1-4506-adfa-93b2cbcff4ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:51.568157 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3764febd-07a1-4506-adfa-93b2cbcff4ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:51.568605 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3764febd-07a1-4506-adfa-93b2cbcff4ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:51.696798 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3764febd-07a1-4506-adfa-93b2cbcff4ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:51.706013 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3764febd-07a1-4506-adfa-93b2cbcff4ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:51.707504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3764febd-07a1-4506-adfa-93b2cbcff4ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:51.708753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3764febd-07a1-4506-adfa-93b2cbcff4ad tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1808 microversion: 2.20 time: 0.154359 Aug 24 16:53:51.709313 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 279/557] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:51 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:51.998462 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d2dd730a-f40a-4646-a16f-f8eb2efca86d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:51.999105 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d2dd730a-f40a-4646-a16f-f8eb2efca86d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:52.002052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=36 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:52.006867 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2dd730a-f40a-4646-a16f-f8eb2efca86d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:52.007346 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2dd730a-f40a-4646-a16f-f8eb2efca86d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:52.007782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2dd730a-f40a-4646-a16f-f8eb2efca86d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:52.008503 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2dd730a-f40a-4646-a16f-f8eb2efca86d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:52.008960 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2dd730a-f40a-4646-a16f-f8eb2efca86d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:52.009386 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2dd730a-f40a-4646-a16f-f8eb2efca86d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:52.137991 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d2dd730a-f40a-4646-a16f-f8eb2efca86d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:52.146101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d2dd730a-f40a-4646-a16f-f8eb2efca86d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.152020 Aug 24 16:53:52.146663 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 279/558] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:51 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:52.732107 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6fa6d3e3-c026-4939-a7ef-1b9573498a79 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:52.732751 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6fa6d3e3-c026-4939-a7ef-1b9573498a79 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:52.739343 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6fa6d3e3-c026-4939-a7ef-1b9573498a79 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:52.739824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6fa6d3e3-c026-4939-a7ef-1b9573498a79 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:52.740286 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6fa6d3e3-c026-4939-a7ef-1b9573498a79 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:52.741004 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6fa6d3e3-c026-4939-a7ef-1b9573498a79 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:52.741458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6fa6d3e3-c026-4939-a7ef-1b9573498a79 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:52.741879 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6fa6d3e3-c026-4939-a7ef-1b9573498a79 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:52.867548 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6fa6d3e3-c026-4939-a7ef-1b9573498a79 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:52.877176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6fa6d3e3-c026-4939-a7ef-1b9573498a79 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:52.878697 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6fa6d3e3-c026-4939-a7ef-1b9573498a79 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:52.879856 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6fa6d3e3-c026-4939-a7ef-1b9573498a79 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1795 microversion: 2.20 time: 0.151644 Aug 24 16:53:52.880423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 280/559] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:53:52 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1795 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:53:53.167010 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ccadb44b-9b37-4113-beaa-b40ccfa93fa6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:53.167658 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ccadb44b-9b37-4113-beaa-b40ccfa93fa6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:53.174743 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccadb44b-9b37-4113-beaa-b40ccfa93fa6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:53.175268 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccadb44b-9b37-4113-beaa-b40ccfa93fa6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:53.175706 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccadb44b-9b37-4113-beaa-b40ccfa93fa6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:53.176422 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccadb44b-9b37-4113-beaa-b40ccfa93fa6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:53.176884 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccadb44b-9b37-4113-beaa-b40ccfa93fa6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:53.177315 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccadb44b-9b37-4113-beaa-b40ccfa93fa6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:53.304140 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ccadb44b-9b37-4113-beaa-b40ccfa93fa6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:53.320772 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ccadb44b-9b37-4113-beaa-b40ccfa93fa6 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.157593 Aug 24 16:53:53.321345 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 280/560] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:53 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:54.342485 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-925d3de8-43b7-4f33-91e4-0348511d05d4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:54.343097 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-925d3de8-43b7-4f33-91e4-0348511d05d4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:54.349479 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-925d3de8-43b7-4f33-91e4-0348511d05d4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:54.349957 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-925d3de8-43b7-4f33-91e4-0348511d05d4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:54.350391 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-925d3de8-43b7-4f33-91e4-0348511d05d4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:54.351078 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-925d3de8-43b7-4f33-91e4-0348511d05d4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:54.351531 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-925d3de8-43b7-4f33-91e4-0348511d05d4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:54.351953 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-925d3de8-43b7-4f33-91e4-0348511d05d4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:54.705188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-925d3de8-43b7-4f33-91e4-0348511d05d4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:54.713568 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-925d3de8-43b7-4f33-91e4-0348511d05d4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.375066 Aug 24 16:53:54.716497 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 281/561] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:54 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:55.737356 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f6e05236-1824-414c-8dff-74d1b226ebbd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:55.737963 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f6e05236-1824-414c-8dff-74d1b226ebbd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:55.745151 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f6e05236-1824-414c-8dff-74d1b226ebbd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:55.745622 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f6e05236-1824-414c-8dff-74d1b226ebbd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:55.746049 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f6e05236-1824-414c-8dff-74d1b226ebbd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:55.747271 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f6e05236-1824-414c-8dff-74d1b226ebbd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:55.747721 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f6e05236-1824-414c-8dff-74d1b226ebbd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:55.748138 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f6e05236-1824-414c-8dff-74d1b226ebbd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:55.885965 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f6e05236-1824-414c-8dff-74d1b226ebbd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:55.894152 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f6e05236-1824-414c-8dff-74d1b226ebbd tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.160588 Aug 24 16:53:55.894711 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 281/562] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:55 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:56.917560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f6ed5be6-ba43-43fc-80c3-1f2c942627ec tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:56.918174 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f6ed5be6-ba43-43fc-80c3-1f2c942627ec tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:56.925214 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6ed5be6-ba43-43fc-80c3-1f2c942627ec tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:56.925700 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6ed5be6-ba43-43fc-80c3-1f2c942627ec tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:56.926135 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6ed5be6-ba43-43fc-80c3-1f2c942627ec tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:56.926822 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6ed5be6-ba43-43fc-80c3-1f2c942627ec tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:56.927279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6ed5be6-ba43-43fc-80c3-1f2c942627ec tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:56.927698 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6ed5be6-ba43-43fc-80c3-1f2c942627ec tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:57.054071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f6ed5be6-ba43-43fc-80c3-1f2c942627ec tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:57.062757 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f6ed5be6-ba43-43fc-80c3-1f2c942627ec tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.149062 Aug 24 16:53:57.063322 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 282/563] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:56 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:58.083796 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-83a1f988-3e73-406e-a8d1-5dca256046d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:58.084429 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-83a1f988-3e73-406e-a8d1-5dca256046d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:58.090872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83a1f988-3e73-406e-a8d1-5dca256046d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:58.091355 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83a1f988-3e73-406e-a8d1-5dca256046d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:58.092360 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83a1f988-3e73-406e-a8d1-5dca256046d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:58.093076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83a1f988-3e73-406e-a8d1-5dca256046d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:58.093534 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83a1f988-3e73-406e-a8d1-5dca256046d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:58.093958 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83a1f988-3e73-406e-a8d1-5dca256046d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:58.219126 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-83a1f988-3e73-406e-a8d1-5dca256046d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:58.227249 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-83a1f988-3e73-406e-a8d1-5dca256046d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.147241 Aug 24 16:53:58.227812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 282/564] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:58 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:59.248706 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-23582997-91f3-45e7-b69e-fcd53a033113 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:59.249276 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-23582997-91f3-45e7-b69e-fcd53a033113 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:59.255921 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23582997-91f3-45e7-b69e-fcd53a033113 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:59.256419 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23582997-91f3-45e7-b69e-fcd53a033113 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:59.256867 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23582997-91f3-45e7-b69e-fcd53a033113 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:59.257553 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23582997-91f3-45e7-b69e-fcd53a033113 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:59.258004 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23582997-91f3-45e7-b69e-fcd53a033113 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:59.258425 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23582997-91f3-45e7-b69e-fcd53a033113 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:59.387478 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-23582997-91f3-45e7-b69e-fcd53a033113 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:59.396131 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-23582997-91f3-45e7-b69e-fcd53a033113 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.151535 Aug 24 16:53:59.396733 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 283/565] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:59 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:00.417871 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2c488633-e82a-4b4a-87f8-7fece9f48e26 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:00.418477 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2c488633-e82a-4b4a-87f8-7fece9f48e26 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:00.425403 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2c488633-e82a-4b4a-87f8-7fece9f48e26 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:00.425891 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2c488633-e82a-4b4a-87f8-7fece9f48e26 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:00.426331 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2c488633-e82a-4b4a-87f8-7fece9f48e26 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:00.427022 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2c488633-e82a-4b4a-87f8-7fece9f48e26 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:00.427480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2c488633-e82a-4b4a-87f8-7fece9f48e26 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:00.427910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2c488633-e82a-4b4a-87f8-7fece9f48e26 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:00.552731 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2c488633-e82a-4b4a-87f8-7fece9f48e26 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:00.560916 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2c488633-e82a-4b4a-87f8-7fece9f48e26 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.146968 Aug 24 16:54:00.561488 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 283/566] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:00 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:01.582598 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6d20770c-0798-4e20-b00e-470bcd71b7fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:01.583230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6d20770c-0798-4e20-b00e-470bcd71b7fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:01.589752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d20770c-0798-4e20-b00e-470bcd71b7fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:01.590238 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d20770c-0798-4e20-b00e-470bcd71b7fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:01.590653 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d20770c-0798-4e20-b00e-470bcd71b7fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:01.591329 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d20770c-0798-4e20-b00e-470bcd71b7fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:01.591806 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d20770c-0798-4e20-b00e-470bcd71b7fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:01.592220 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d20770c-0798-4e20-b00e-470bcd71b7fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:01.722097 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6d20770c-0798-4e20-b00e-470bcd71b7fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:01.730173 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6d20770c-0798-4e20-b00e-470bcd71b7fa tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.151456 Aug 24 16:54:01.730741 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 284/567] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:01 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:02.752363 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-25a0cb8b-8303-4395-9f40-e52f91421be9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:02.753076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-25a0cb8b-8303-4395-9f40-e52f91421be9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:02.759406 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-25a0cb8b-8303-4395-9f40-e52f91421be9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:02.759885 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-25a0cb8b-8303-4395-9f40-e52f91421be9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:02.760315 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-25a0cb8b-8303-4395-9f40-e52f91421be9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:02.761023 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-25a0cb8b-8303-4395-9f40-e52f91421be9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:02.761475 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-25a0cb8b-8303-4395-9f40-e52f91421be9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:02.761894 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-25a0cb8b-8303-4395-9f40-e52f91421be9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:02.890136 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-25a0cb8b-8303-4395-9f40-e52f91421be9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:02.898554 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-25a0cb8b-8303-4395-9f40-e52f91421be9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.150858 Aug 24 16:54:02.899127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 284/568] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:02 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:03.920173 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-39f78c68-c2b1-410d-b5b1-fb1f31bad6d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:03.920779 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-39f78c68-c2b1-410d-b5b1-fb1f31bad6d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:03.927708 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39f78c68-c2b1-410d-b5b1-fb1f31bad6d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:03.933231 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39f78c68-c2b1-410d-b5b1-fb1f31bad6d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:03.933231 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39f78c68-c2b1-410d-b5b1-fb1f31bad6d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:03.933231 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39f78c68-c2b1-410d-b5b1-fb1f31bad6d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:03.933231 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39f78c68-c2b1-410d-b5b1-fb1f31bad6d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:03.933617 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39f78c68-c2b1-410d-b5b1-fb1f31bad6d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:04.054854 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-39f78c68-c2b1-410d-b5b1-fb1f31bad6d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:04.062951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-39f78c68-c2b1-410d-b5b1-fb1f31bad6d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.146844 Aug 24 16:54:04.063560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 285/569] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:03 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:05.084521 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9a5a6a40-63c7-4324-abac-23ca1cefc0ca tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:05.085136 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9a5a6a40-63c7-4324-abac-23ca1cefc0ca tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:05.091490 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a5a6a40-63c7-4324-abac-23ca1cefc0ca tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:05.091974 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a5a6a40-63c7-4324-abac-23ca1cefc0ca tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:05.092423 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a5a6a40-63c7-4324-abac-23ca1cefc0ca tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:05.093111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a5a6a40-63c7-4324-abac-23ca1cefc0ca tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:05.093564 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a5a6a40-63c7-4324-abac-23ca1cefc0ca tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:05.093990 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a5a6a40-63c7-4324-abac-23ca1cefc0ca tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:05.225774 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9a5a6a40-63c7-4324-abac-23ca1cefc0ca tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:05.234141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9a5a6a40-63c7-4324-abac-23ca1cefc0ca tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1736 microversion: 2.1 time: 0.153509 Aug 24 16:54:05.234706 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 285/570] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:05 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:06.256939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-10af00cf-c7fb-4baa-bd59-8c3f32f002d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:06.257481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-10af00cf-c7fb-4baa-bd59-8c3f32f002d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:06.263995 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10af00cf-c7fb-4baa-bd59-8c3f32f002d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:06.264506 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10af00cf-c7fb-4baa-bd59-8c3f32f002d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:06.264938 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10af00cf-c7fb-4baa-bd59-8c3f32f002d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:06.265614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10af00cf-c7fb-4baa-bd59-8c3f32f002d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:06.266061 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10af00cf-c7fb-4baa-bd59-8c3f32f002d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:06.266478 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10af00cf-c7fb-4baa-bd59-8c3f32f002d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:06.394663 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-10af00cf-c7fb-4baa-bd59-8c3f32f002d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:06.402929 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-10af00cf-c7fb-4baa-bd59-8c3f32f002d9 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1716 microversion: 2.1 time: 0.149922 Aug 24 16:54:06.403515 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 286/571] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:06 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:06.479340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fa28decf-12af-4b21-aff1-079e49ac1f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:06.479851 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fa28decf-12af-4b21-aff1-079e49ac1f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:06.486917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa28decf-12af-4b21-aff1-079e49ac1f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:06.487402 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa28decf-12af-4b21-aff1-079e49ac1f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:06.487839 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa28decf-12af-4b21-aff1-079e49ac1f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:06.488564 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa28decf-12af-4b21-aff1-079e49ac1f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:06.489025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa28decf-12af-4b21-aff1-079e49ac1f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:06.489451 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa28decf-12af-4b21-aff1-079e49ac1f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:06.614111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-fa28decf-12af-4b21-aff1-079e49ac1f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] HTTP exception thrown: Cannot 'detach_volume' instance 84ecc526-a083-4f47-ac70-0b06d5b66158 while it is in vm_state rescued Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fa28decf-12af-4b21-aff1-079e49ac1f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Request method failure captured: Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: DELETE /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-volume_attachments/8729176a-3c8d-4f1b-bf15-1fd9d8be916f HTTP/1.1 Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZISQVjDYN-eIogkcFZs4LwnKoC8sLc9FZzdslGTzUrTNQWcUS4KZag3pL6aq7dRyIc2KFLdQFiK-4WL410C3YKTO4TmPCffofqSVR3WjOCdAkm3OD1T4kuqoqivwNCWFfuz5cdlLKVbaudAbBuC_4ZmqoIRB4h0CNWV89o1uMxmgw Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 42f5635b43e74a96a56d56cccbc111b5 Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:54:06.615719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:54:06.617111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:54:06.617111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:54:06.617111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 42f5635b43e74a96a56d56cccbc111b5 Aug 24 16:54:06.617111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:54:06.617111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-ServerRescueNegativeTestJSON-175432080-project Aug 24 16:54:06.617111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:54:06.617111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:54:06.617111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 45913fc3d9ba42ea9e971db25e656c61 Aug 24 16:54:06.617111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-175432080-project Aug 24 16:54:06.617111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:54:06.617111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Cannot 'detach_volume' instance 84ecc526-a083-4f47-ac70-0b06d5b66158 while it is in vm_state rescued Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'server_id': '84ecc526-a083-4f47-ac70-0b06d5b66158', 'id': '8729176a-3c8d-4f1b-bf15-1fd9d8be916f'} Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 84ecc526-a083-4f47-ac70-0b06d5b66158 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:54:06.617806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 84ecc526-a083-4f47-ac70-0b06d5b66158 while it is in vm_state rescued Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 84ecc526-a083-4f47-ac70-0b06d5b66158 while it is in vm_state rescued Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:06.619316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fa28decf-12af-4b21-aff1-079e49ac1f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Returning 409 to user: Cannot 'detach_volume' instance 84ecc526-a083-4f47-ac70-0b06d5b66158 while it is in vm_state rescued {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:54:06.620601 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fa28decf-12af-4b21-aff1-079e49ac1f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "DELETE /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-volume_attachments/8729176a-3c8d-4f1b-bf15-1fd9d8be916f" status: 409 len: 152 microversion: 2.1 time: 0.141831 Aug 24 16:54:06.620601 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 286/572] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Aug 24 16:54:06 2022] DELETE /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-volume_attachments/8729176a-3c8d-4f1b-bf15-1fd9d8be916f => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 16:54:06.626036 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b85697a7-f35d-4109-bb26-75a2e1ecc360 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:06.626599 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b85697a7-f35d-4109-bb26-75a2e1ecc360 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:06.632727 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b85697a7-f35d-4109-bb26-75a2e1ecc360 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:06.633270 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b85697a7-f35d-4109-bb26-75a2e1ecc360 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:06.633706 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b85697a7-f35d-4109-bb26-75a2e1ecc360 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:06.634399 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b85697a7-f35d-4109-bb26-75a2e1ecc360 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:06.634851 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b85697a7-f35d-4109-bb26-75a2e1ecc360 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:06.635270 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b85697a7-f35d-4109-bb26-75a2e1ecc360 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:06.888828 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b85697a7-f35d-4109-bb26-75a2e1ecc360 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "POST /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/action" status: 202 len: 0 microversion: 2.1 time: 0.266395 Aug 24 16:54:06.889458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 287/573] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 16:54:06 2022] POST /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:54:06.897970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2d9f8aec-621b-4496-a6b8-de9128642a1b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:06.898580 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2d9f8aec-621b-4496-a6b8-de9128642a1b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:06.905174 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2d9f8aec-621b-4496-a6b8-de9128642a1b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:06.905716 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2d9f8aec-621b-4496-a6b8-de9128642a1b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:06.906151 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2d9f8aec-621b-4496-a6b8-de9128642a1b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:06.906842 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2d9f8aec-621b-4496-a6b8-de9128642a1b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:06.907297 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2d9f8aec-621b-4496-a6b8-de9128642a1b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:06.908285 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2d9f8aec-621b-4496-a6b8-de9128642a1b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:07.035350 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2d9f8aec-621b-4496-a6b8-de9128642a1b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:07.043698 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2d9f8aec-621b-4496-a6b8-de9128642a1b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1724 microversion: 2.1 time: 0.149528 Aug 24 16:54:07.044259 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 287/574] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:06 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:08.066472 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-64ec024b-5312-4145-96e8-6d519ba16028 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:08.067090 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-64ec024b-5312-4145-96e8-6d519ba16028 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:08.073232 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64ec024b-5312-4145-96e8-6d519ba16028 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:08.073722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64ec024b-5312-4145-96e8-6d519ba16028 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:08.074132 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64ec024b-5312-4145-96e8-6d519ba16028 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:08.074813 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64ec024b-5312-4145-96e8-6d519ba16028 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:08.075264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64ec024b-5312-4145-96e8-6d519ba16028 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:08.075683 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64ec024b-5312-4145-96e8-6d519ba16028 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:08.206549 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-64ec024b-5312-4145-96e8-6d519ba16028 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:08.226977 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-64ec024b-5312-4145-96e8-6d519ba16028 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1724 microversion: 2.1 time: 0.154603 Aug 24 16:54:08.226977 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 288/575] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:08 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:09.237743 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ce02c343-11ba-4244-9ef1-ea2365f88f18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:09.238356 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ce02c343-11ba-4244-9ef1-ea2365f88f18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:09.244891 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce02c343-11ba-4244-9ef1-ea2365f88f18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:09.245382 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce02c343-11ba-4244-9ef1-ea2365f88f18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:09.245824 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce02c343-11ba-4244-9ef1-ea2365f88f18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:09.246515 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce02c343-11ba-4244-9ef1-ea2365f88f18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:09.246971 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce02c343-11ba-4244-9ef1-ea2365f88f18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:09.247467 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce02c343-11ba-4244-9ef1-ea2365f88f18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:09.371964 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ce02c343-11ba-4244-9ef1-ea2365f88f18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:09.380908 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ce02c343-11ba-4244-9ef1-ea2365f88f18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1724 microversion: 2.1 time: 0.147158 Aug 24 16:54:09.381472 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 288/576] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:09 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:10.402673 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0832aeac-85d0-4502-a46f-f49cf5c8cbeb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:10.403279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0832aeac-85d0-4502-a46f-f49cf5c8cbeb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:10.410166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0832aeac-85d0-4502-a46f-f49cf5c8cbeb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:10.410635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0832aeac-85d0-4502-a46f-f49cf5c8cbeb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:10.411066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0832aeac-85d0-4502-a46f-f49cf5c8cbeb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:10.411763 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0832aeac-85d0-4502-a46f-f49cf5c8cbeb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:10.412206 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0832aeac-85d0-4502-a46f-f49cf5c8cbeb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:10.412653 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0832aeac-85d0-4502-a46f-f49cf5c8cbeb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:10.546736 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0832aeac-85d0-4502-a46f-f49cf5c8cbeb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:10.554897 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0832aeac-85d0-4502-a46f-f49cf5c8cbeb tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1724 microversion: 2.1 time: 0.156113 Aug 24 16:54:10.555459 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 289/577] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:10 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:11.575197 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7246a497-c5de-4c43-b8f8-d4d501ad5e5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:11.575739 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7246a497-c5de-4c43-b8f8-d4d501ad5e5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:11.582232 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7246a497-c5de-4c43-b8f8-d4d501ad5e5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:11.582725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7246a497-c5de-4c43-b8f8-d4d501ad5e5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:11.583173 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7246a497-c5de-4c43-b8f8-d4d501ad5e5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:11.583866 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7246a497-c5de-4c43-b8f8-d4d501ad5e5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:11.584324 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7246a497-c5de-4c43-b8f8-d4d501ad5e5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:11.584777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7246a497-c5de-4c43-b8f8-d4d501ad5e5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:11.714610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7246a497-c5de-4c43-b8f8-d4d501ad5e5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:11.723197 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7246a497-c5de-4c43-b8f8-d4d501ad5e5c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1724 microversion: 2.1 time: 0.151992 Aug 24 16:54:11.723769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 289/578] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:11 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:12.744702 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0cde821d-1822-4f7a-a2ad-2fb69f22218f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:12.745265 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0cde821d-1822-4f7a-a2ad-2fb69f22218f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:12.751618 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cde821d-1822-4f7a-a2ad-2fb69f22218f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:12.752355 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cde821d-1822-4f7a-a2ad-2fb69f22218f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:12.752828 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cde821d-1822-4f7a-a2ad-2fb69f22218f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:12.753515 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cde821d-1822-4f7a-a2ad-2fb69f22218f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:12.753991 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cde821d-1822-4f7a-a2ad-2fb69f22218f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:12.754413 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cde821d-1822-4f7a-a2ad-2fb69f22218f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:12.772482 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:12.884543 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0cde821d-1822-4f7a-a2ad-2fb69f22218f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:12.892623 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0cde821d-1822-4f7a-a2ad-2fb69f22218f tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1730 microversion: 2.1 time: 0.152075 Aug 24 16:54:12.893184 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 290/579] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:12 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:12.913803 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-75a751d5-7c66-4cef-93e1-9aae7fccaa53 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:12.914328 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-75a751d5-7c66-4cef-93e1-9aae7fccaa53 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:12.920701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-75a751d5-7c66-4cef-93e1-9aae7fccaa53 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:12.921205 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-75a751d5-7c66-4cef-93e1-9aae7fccaa53 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:12.926033 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-75a751d5-7c66-4cef-93e1-9aae7fccaa53 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:12.926033 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-75a751d5-7c66-4cef-93e1-9aae7fccaa53 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:12.926033 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-75a751d5-7c66-4cef-93e1-9aae7fccaa53 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:12.926033 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-75a751d5-7c66-4cef-93e1-9aae7fccaa53 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:12.998901 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-75a751d5-7c66-4cef-93e1-9aae7fccaa53 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089435 Aug 24 16:54:12.999503 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 290/580] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Aug 24 16:54:12 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:14.000204 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-cdc4b73e-262d-422e-a3b7-db285596a45a req-f96dd7f6-a52a-4188-bebd-4832f8722ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ecc526-a083-4f47-ac70-0b06d5b66158", "tag": "4cb866ee-2954-4fbb-953c-0cde1c4ca053"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:14.010642 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-cdc4b73e-262d-422e-a3b7-db285596a45a req-f96dd7f6-a52a-4188-bebd-4832f8722ad1 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:14.011160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-cdc4b73e-262d-422e-a3b7-db285596a45a req-f96dd7f6-a52a-4188-bebd-4832f8722ad1 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:14.011596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-cdc4b73e-262d-422e-a3b7-db285596a45a req-f96dd7f6-a52a-4188-bebd-4832f8722ad1 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:14.022706 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-cdc4b73e-262d-422e-a3b7-db285596a45a req-f96dd7f6-a52a-4188-bebd-4832f8722ad1 service nova] Creating event network-changed:4cb866ee-2954-4fbb-953c-0cde1c4ca053 for instance 84ecc526-a083-4f47-ac70-0b06d5b66158 on hv-cinder-85220 Aug 24 16:54:14.027712 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-cdc4b73e-262d-422e-a3b7-db285596a45a req-f96dd7f6-a52a-4188-bebd-4832f8722ad1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087373 Aug 24 16:54:14.028305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 291/581] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:16.042067 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-7d148dc7-ea50-4885-aca6-e35119afb2df req-d8c00a68-afde-4586-97f4-85c6b92bbe3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ecc526-a083-4f47-ac70-0b06d5b66158", "tag": "4cb866ee-2954-4fbb-953c-0cde1c4ca053"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:16.051312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-7d148dc7-ea50-4885-aca6-e35119afb2df req-d8c00a68-afde-4586-97f4-85c6b92bbe3b service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:16.051790 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-7d148dc7-ea50-4885-aca6-e35119afb2df req-d8c00a68-afde-4586-97f4-85c6b92bbe3b service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:16.052747 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-7d148dc7-ea50-4885-aca6-e35119afb2df req-d8c00a68-afde-4586-97f4-85c6b92bbe3b service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:16.063454 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-7d148dc7-ea50-4885-aca6-e35119afb2df req-d8c00a68-afde-4586-97f4-85c6b92bbe3b service nova] Creating event network-changed:4cb866ee-2954-4fbb-953c-0cde1c4ca053 for instance 84ecc526-a083-4f47-ac70-0b06d5b66158 on hv-cinder-85220 Aug 24 16:54:16.069018 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-7d148dc7-ea50-4885-aca6-e35119afb2df req-d8c00a68-afde-4586-97f4-85c6b92bbe3b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030247 Aug 24 16:54:16.069584 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 291/582] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:44.938972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=31 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:45.041029 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e18062ae-a25a-439e-b2d2-2a6b7e5d9661 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:45.041613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e18062ae-a25a-439e-b2d2-2a6b7e5d9661 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:45.047594 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e18062ae-a25a-439e-b2d2-2a6b7e5d9661 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:45.048075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e18062ae-a25a-439e-b2d2-2a6b7e5d9661 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:45.048535 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e18062ae-a25a-439e-b2d2-2a6b7e5d9661 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:45.049707 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e18062ae-a25a-439e-b2d2-2a6b7e5d9661 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:45.050155 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e18062ae-a25a-439e-b2d2-2a6b7e5d9661 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:45.050570 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e18062ae-a25a-439e-b2d2-2a6b7e5d9661 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:45.073042 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e18062ae-a25a-439e-b2d2-2a6b7e5d9661 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91/ips" status: 200 len: 148 microversion: 2.1 time: 0.135919 Aug 24 16:54:45.073580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 292/583] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Aug 24 16:54:44 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91/ips => generated 148 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:45.082692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=25 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:45.083437 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=76 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:45.087699 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1f6db786-df4b-4ca9-8844-1a87701194f7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb0bc09c-1d33-48b2-86cb-97f213f9bb4a"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:45.090197 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1f6db786-df4b-4ca9-8844-1a87701194f7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:45.096936 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f6db786-df4b-4ca9-8844-1a87701194f7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:45.096936 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f6db786-df4b-4ca9-8844-1a87701194f7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:45.097130 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f6db786-df4b-4ca9-8844-1a87701194f7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:45.097724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f6db786-df4b-4ca9-8844-1a87701194f7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:45.098182 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f6db786-df4b-4ca9-8844-1a87701194f7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:45.098607 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f6db786-df4b-4ca9-8844-1a87701194f7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:45.177606 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-1f6db786-df4b-4ca9-8844-1a87701194f7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Invalid volume: volume bb0bc09c-1d33-48b2-86cb-97f213f9bb4a is already attached to instances: ff0a3b74-291b-4381-b945-50b48a823978 Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1f6db786-df4b-4ca9-8844-1a87701194f7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: POST /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91/os-volume_attachments HTTP/1.1 Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 74 Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:54:45.179306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:54:45.180882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:54:45.180882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:54:45.180882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:54:45.180882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:54:45.180882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:54:45.180882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:54:45.180882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:54:45.180882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:54:45.180882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:54:45.180882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Aug 24 16:54:45.180882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {"volumeAttachment": {"volumeId": "bb0bc09c-1d33-48b2-86cb-97f213f9bb4a"}} Aug 24 16:54:45.180882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Invalid volume: volume bb0bc09c-1d33-48b2-86cb-97f213f9bb4a is already attached to instances: ff0a3b74-291b-4381-b945-50b48a823978 Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'server_id': '92b81578-b6c8-4fbf-9451-51d1fec79b91', 'body': {'volumeAttachment': {'volumeId': 'bb0bc09c-1d33-48b2-86cb-97f213f9bb4a'}}} Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bb0bc09c-1d33-48b2-86cb-97f213f9bb4a is already attached to instances: ff0a3b74-291b-4381-b945-50b48a823978 Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:45.181786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bb0bc09c-1d33-48b2-86cb-97f213f9bb4a is already attached to instances: ff0a3b74-291b-4381-b945-50b48a823978 Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:54:45.183431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:54:45.185064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:54:45.185064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:54:45.185064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:54:45.185064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bb0bc09c-1d33-48b2-86cb-97f213f9bb4a is already attached to instances: ff0a3b74-291b-4381-b945-50b48a823978 Aug 24 16:54:45.185064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:45.185064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1f6db786-df4b-4ca9-8844-1a87701194f7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 400 to user: Invalid volume: volume bb0bc09c-1d33-48b2-86cb-97f213f9bb4a is already attached to instances: ff0a3b74-291b-4381-b945-50b48a823978 {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:54:45.185064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1f6db786-df4b-4ca9-8844-1a87701194f7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "POST /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099783 Aug 24 16:54:45.185064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 292/584] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 16:54:45 2022] POST /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:54:45.189762 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-be695327-5a49-4d16-8a72-1f250848eead tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:45.190243 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-be695327-5a49-4d16-8a72-1f250848eead tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:45.196146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be695327-5a49-4d16-8a72-1f250848eead tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:45.196664 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be695327-5a49-4d16-8a72-1f250848eead tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:45.197103 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be695327-5a49-4d16-8a72-1f250848eead tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:45.197791 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be695327-5a49-4d16-8a72-1f250848eead tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:45.198246 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be695327-5a49-4d16-8a72-1f250848eead tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:45.198669 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be695327-5a49-4d16-8a72-1f250848eead tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:45.223032 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-be695327-5a49-4d16-8a72-1f250848eead tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:54:45.586545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-be695327-5a49-4d16-8a72-1f250848eead tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 204 len: 0 microversion: 2.1 time: 0.400306 Aug 24 16:54:45.587145 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 293/585] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:54:45 2022] DELETE /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:54:45.595152 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-62a3cdf6-f13f-470a-aef1-28c82a0b68aa tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:45.596252 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-62a3cdf6-f13f-470a-aef1-28c82a0b68aa tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:45.602194 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-62a3cdf6-f13f-470a-aef1-28c82a0b68aa tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:45.602672 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-62a3cdf6-f13f-470a-aef1-28c82a0b68aa tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:45.603102 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-62a3cdf6-f13f-470a-aef1-28c82a0b68aa tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:45.603783 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-62a3cdf6-f13f-470a-aef1-28c82a0b68aa tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:45.604230 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-62a3cdf6-f13f-470a-aef1-28c82a0b68aa tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:45.604687 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-62a3cdf6-f13f-470a-aef1-28c82a0b68aa tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:45.734706 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-62a3cdf6-f13f-470a-aef1-28c82a0b68aa tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:45.743027 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-62a3cdf6-f13f-470a-aef1-28c82a0b68aa tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1680 microversion: 2.1 time: 0.151674 Aug 24 16:54:45.743590 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 293/586] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:45 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:46.764754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5ca8291e-d71f-4f6a-b692-c96dce3fa4cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:46.765453 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5ca8291e-d71f-4f6a-b692-c96dce3fa4cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:46.772336 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ca8291e-d71f-4f6a-b692-c96dce3fa4cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:46.772852 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ca8291e-d71f-4f6a-b692-c96dce3fa4cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:46.773284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ca8291e-d71f-4f6a-b692-c96dce3fa4cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:46.773969 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ca8291e-d71f-4f6a-b692-c96dce3fa4cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:46.774597 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ca8291e-d71f-4f6a-b692-c96dce3fa4cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:46.775038 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ca8291e-d71f-4f6a-b692-c96dce3fa4cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:46.908033 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5ca8291e-d71f-4f6a-b692-c96dce3fa4cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:46.916143 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5ca8291e-d71f-4f6a-b692-c96dce3fa4cf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1680 microversion: 2.1 time: 0.155759 Aug 24 16:54:46.916741 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 294/587] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:46 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:47.939472 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fa0c700b-f9fb-4534-8063-44a4ae0fa2e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:47.940691 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fa0c700b-f9fb-4534-8063-44a4ae0fa2e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:47.947070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa0c700b-f9fb-4534-8063-44a4ae0fa2e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:47.947751 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa0c700b-f9fb-4534-8063-44a4ae0fa2e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:47.948681 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa0c700b-f9fb-4534-8063-44a4ae0fa2e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:47.949628 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa0c700b-f9fb-4534-8063-44a4ae0fa2e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:47.950242 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa0c700b-f9fb-4534-8063-44a4ae0fa2e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:47.951384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fa0c700b-f9fb-4534-8063-44a4ae0fa2e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:48.087567 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fa0c700b-f9fb-4534-8063-44a4ae0fa2e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:48.095222 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fa0c700b-f9fb-4534-8063-44a4ae0fa2e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1680 microversion: 2.1 time: 0.160901 Aug 24 16:54:48.101692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 294/588] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:47 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:48.493795 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-89c1b7a4-da71-4893-b248-736f5d645c5e req-842c5727-22f3-4066-9ca9-51e71fe32471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b81578-b6c8-4fbf-9451-51d1fec79b91", "name": "network-vif-deleted", "tag": "33fa5a2a-0d21-4685-9bef-eeffec861ec9"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:48.503509 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-89c1b7a4-da71-4893-b248-736f5d645c5e req-842c5727-22f3-4066-9ca9-51e71fe32471 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:48.503980 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-89c1b7a4-da71-4893-b248-736f5d645c5e req-842c5727-22f3-4066-9ca9-51e71fe32471 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:48.504430 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-89c1b7a4-da71-4893-b248-736f5d645c5e req-842c5727-22f3-4066-9ca9-51e71fe32471 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:48.515518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-89c1b7a4-da71-4893-b248-736f5d645c5e req-842c5727-22f3-4066-9ca9-51e71fe32471 service nova] Creating event network-vif-deleted:33fa5a2a-0d21-4685-9bef-eeffec861ec9 for instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 on hv-cinder-85220 Aug 24 16:54:48.521077 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-89c1b7a4-da71-4893-b248-736f5d645c5e req-842c5727-22f3-4066-9ca9-51e71fe32471 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086683 Aug 24 16:54:48.528075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 295/589] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:49.117070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:49.117620 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:49.124760 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:49.125253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:49.125681 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:49.126381 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:49.127341 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:49.128201 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:49.160997 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:49.161481 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:49.161907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:49.162362 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lazy-loading 'fault' on Instance uuid 92b81578-b6c8-4fbf-9451-51d1fec79b91 {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:54:49.210997 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:49.219560 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a2c68e1a-8d40-4cd7-8a01-685625169278 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 200 len: 1331 microversion: 2.1 time: 0.106434 Aug 24 16:54:49.223619 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 295/590] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:49 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:50.241867 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c27ef53c-bc2a-497f-9ac7-09fe0e698b26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:50.242558 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c27ef53c-bc2a-497f-9ac7-09fe0e698b26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:50.248661 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c27ef53c-bc2a-497f-9ac7-09fe0e698b26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:50.249140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c27ef53c-bc2a-497f-9ac7-09fe0e698b26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:50.249567 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c27ef53c-bc2a-497f-9ac7-09fe0e698b26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:50.250252 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c27ef53c-bc2a-497f-9ac7-09fe0e698b26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:50.250707 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c27ef53c-bc2a-497f-9ac7-09fe0e698b26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:50.251125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c27ef53c-bc2a-497f-9ac7-09fe0e698b26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:50.264187 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-c27ef53c-bc2a-497f-9ac7-09fe0e698b26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c27ef53c-bc2a-497f-9ac7-09fe0e698b26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 HTTP/1.1 Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:54:50.265917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:54:50.267408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:54:50.267408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:54:50.267408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:54:50.267408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:54:50.267408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:54:50.267408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:54:50.267408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:54:50.267408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:54:50.267408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:54:50.267408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:54:50.267408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:54:50.267408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '92b81578-b6c8-4fbf-9451-51d1fec79b91'} Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:54:50.268975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:54:50.270408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:54:50.271861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c27ef53c-bc2a-497f-9ac7-09fe0e698b26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 404 to user: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:54:50.271861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c27ef53c-bc2a-497f-9ac7-09fe0e698b26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 404 len: 111 microversion: 2.1 time: 0.030687 Aug 24 16:54:50.271861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 296/591] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:50 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:54:50.276545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-86e89c60-4a2f-435f-87dc-00f33570b80a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '.version_select at 0x7fa194a480d0>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:50.342999 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-86e89c60-4a2f-435f-87dc-00f33570b80a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-797435066" status: 202 len: 0 microversion: 2.1 time: 0.070260 Aug 24 16:54:50.343560 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 296/592] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Aug 24 16:54:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-797435066 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:54:51.243225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9ca2a077-b93a-486f-9d2a-739eb2093108 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:51.243832 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9ca2a077-b93a-486f-9d2a-739eb2093108 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:51.250459 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ca2a077-b93a-486f-9d2a-739eb2093108 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:51.250940 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ca2a077-b93a-486f-9d2a-739eb2093108 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:51.251372 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ca2a077-b93a-486f-9d2a-739eb2093108 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:51.252137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ca2a077-b93a-486f-9d2a-739eb2093108 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:51.252634 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ca2a077-b93a-486f-9d2a-739eb2093108 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:51.253332 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ca2a077-b93a-486f-9d2a-739eb2093108 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:51.375347 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-9ca2a077-b93a-486f-9d2a-739eb2093108 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lazy-loading 'services' on Instance uuid ff0a3b74-291b-4381-b945-50b48a823978 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:54:51.592394 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9ca2a077-b93a-486f-9d2a-739eb2093108 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/os-volume_attachments/bb0bc09c-1d33-48b2-86cb-97f213f9bb4a" status: 202 len: 0 microversion: 2.1 time: 0.352902 Aug 24 16:54:51.593081 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 297/593] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Aug 24 16:54:51 2022] DELETE /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/os-volume_attachments/bb0bc09c-1d33-48b2-86cb-97f213f9bb4a => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:54:51.602391 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ff2f5530-9a9d-41ed-833f-9171a15889e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:51.604554 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ff2f5530-9a9d-41ed-833f-9171a15889e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:51.611138 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ff2f5530-9a9d-41ed-833f-9171a15889e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:51.612259 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ff2f5530-9a9d-41ed-833f-9171a15889e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:51.612729 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ff2f5530-9a9d-41ed-833f-9171a15889e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:51.613491 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ff2f5530-9a9d-41ed-833f-9171a15889e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:51.613952 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ff2f5530-9a9d-41ed-833f-9171a15889e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:51.614385 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ff2f5530-9a9d-41ed-833f-9171a15889e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:51.643287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ff2f5530-9a9d-41ed-833f-9171a15889e3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045390 Aug 24 16:54:51.643844 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 297/594] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:54:51 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:52.656928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-03962404-fa27-4d1e-ada1-679ebfc18a43 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:52.659961 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-03962404-fa27-4d1e-ada1-679ebfc18a43 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:52.666892 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03962404-fa27-4d1e-ada1-679ebfc18a43 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:52.667371 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03962404-fa27-4d1e-ada1-679ebfc18a43 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:52.667810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03962404-fa27-4d1e-ada1-679ebfc18a43 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:52.668532 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03962404-fa27-4d1e-ada1-679ebfc18a43 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:52.668985 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03962404-fa27-4d1e-ada1-679ebfc18a43 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:52.669407 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03962404-fa27-4d1e-ada1-679ebfc18a43 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:52.698492 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-03962404-fa27-4d1e-ada1-679ebfc18a43 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047117 Aug 24 16:54:52.698954 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 298/595] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:54:52 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:53.711400 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-50687762-e318-453f-bae8-6a6103af697e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:53.713612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-50687762-e318-453f-bae8-6a6103af697e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:53.719974 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-50687762-e318-453f-bae8-6a6103af697e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:53.720491 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-50687762-e318-453f-bae8-6a6103af697e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:53.720969 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-50687762-e318-453f-bae8-6a6103af697e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:53.721658 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-50687762-e318-453f-bae8-6a6103af697e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:53.722118 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-50687762-e318-453f-bae8-6a6103af697e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:53.722546 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-50687762-e318-453f-bae8-6a6103af697e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:53.750707 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-50687762-e318-453f-bae8-6a6103af697e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043334 Aug 24 16:54:53.751257 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 298/596] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:54:53 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:54:53.812031 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a1bd4d91-80f3-47e6-8dd2-d7da1300ba29 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:53.812592 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a1bd4d91-80f3-47e6-8dd2-d7da1300ba29 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:53.819374 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a1bd4d91-80f3-47e6-8dd2-d7da1300ba29 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:53.822398 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a1bd4d91-80f3-47e6-8dd2-d7da1300ba29 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:53.822398 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a1bd4d91-80f3-47e6-8dd2-d7da1300ba29 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:53.822398 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a1bd4d91-80f3-47e6-8dd2-d7da1300ba29 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:53.822398 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a1bd4d91-80f3-47e6-8dd2-d7da1300ba29 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:53.822765 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a1bd4d91-80f3-47e6-8dd2-d7da1300ba29 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:53.850189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a1bd4d91-80f3-47e6-8dd2-d7da1300ba29 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:54:54.105933 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a1bd4d91-80f3-47e6-8dd2-d7da1300ba29 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 204 len: 0 microversion: 2.1 time: 0.297444 Aug 24 16:54:54.106519 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 299/597] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:54:53 2022] DELETE /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:54:54.115406 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-83581524-4d61-4076-99ce-eac9b59a02e0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:54.116014 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-83581524-4d61-4076-99ce-eac9b59a02e0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:54.121929 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83581524-4d61-4076-99ce-eac9b59a02e0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:54.122410 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83581524-4d61-4076-99ce-eac9b59a02e0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:54.122840 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83581524-4d61-4076-99ce-eac9b59a02e0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:54.123537 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83581524-4d61-4076-99ce-eac9b59a02e0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:54.123971 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83581524-4d61-4076-99ce-eac9b59a02e0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:54.124392 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83581524-4d61-4076-99ce-eac9b59a02e0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:54.250181 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-83581524-4d61-4076-99ce-eac9b59a02e0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:54.258636 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-83581524-4d61-4076-99ce-eac9b59a02e0 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1680 microversion: 2.1 time: 0.147679 Aug 24 16:54:54.259188 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 299/598] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:54 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:55.284701 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b4b03012-5953-4797-ab31-adecf6d550ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:55.285320 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b4b03012-5953-4797-ab31-adecf6d550ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:55.291737 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4b03012-5953-4797-ab31-adecf6d550ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:55.292211 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4b03012-5953-4797-ab31-adecf6d550ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:55.292670 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4b03012-5953-4797-ab31-adecf6d550ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:55.293353 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4b03012-5953-4797-ab31-adecf6d550ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:55.293797 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4b03012-5953-4797-ab31-adecf6d550ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:55.294213 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4b03012-5953-4797-ab31-adecf6d550ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:55.431303 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b4b03012-5953-4797-ab31-adecf6d550ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:55.440131 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b4b03012-5953-4797-ab31-adecf6d550ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1680 microversion: 2.1 time: 0.158816 Aug 24 16:54:55.440320 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 300/599] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:55 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:55.913382 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-52ed0d6f-d8ab-4e2c-a331-67b2f4f5cca2 req-41490392-fdaf-46b3-bbe0-4844f3fa1a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff0a3b74-291b-4381-b945-50b48a823978", "name": "network-vif-deleted", "tag": "83352098-6ea5-4bd7-aa7b-077d1f804efe"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:55.923572 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-52ed0d6f-d8ab-4e2c-a331-67b2f4f5cca2 req-41490392-fdaf-46b3-bbe0-4844f3fa1a19 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:55.934155 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-52ed0d6f-d8ab-4e2c-a331-67b2f4f5cca2 req-41490392-fdaf-46b3-bbe0-4844f3fa1a19 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:55.934155 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-52ed0d6f-d8ab-4e2c-a331-67b2f4f5cca2 req-41490392-fdaf-46b3-bbe0-4844f3fa1a19 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:55.947787 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-52ed0d6f-d8ab-4e2c-a331-67b2f4f5cca2 req-41490392-fdaf-46b3-bbe0-4844f3fa1a19 service nova] Creating event network-vif-deleted:83352098-6ea5-4bd7-aa7b-077d1f804efe for instance ff0a3b74-291b-4381-b945-50b48a823978 on hv-cinder-85220 Aug 24 16:54:55.957959 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-52ed0d6f-d8ab-4e2c-a331-67b2f4f5cca2 req-41490392-fdaf-46b3-bbe0-4844f3fa1a19 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048174 Aug 24 16:54:55.958619 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 300/600] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:56.461561 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:56.462197 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:56.468724 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:56.475370 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:56.475370 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:56.475370 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:56.475370 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:56.475737 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:56.503589 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:56.504071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:56.504538 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:56.505054 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lazy-loading 'fault' on Instance uuid ff0a3b74-291b-4381-b945-50b48a823978 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:54:56.546588 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:56.554323 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-36974324-34b2-4223-ba39-7d26fbb70cf3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 200 len: 1331 microversion: 2.1 time: 0.096976 Aug 24 16:54:56.554928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 301/601] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:56 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:57.576209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-bebd35cd-2e7f-4b38-bc96-593b42068dda tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:57.576930 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-bebd35cd-2e7f-4b38-bc96-593b42068dda tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:57.583096 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bebd35cd-2e7f-4b38-bc96-593b42068dda tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:57.583916 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bebd35cd-2e7f-4b38-bc96-593b42068dda tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:57.584350 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bebd35cd-2e7f-4b38-bc96-593b42068dda tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:57.585058 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bebd35cd-2e7f-4b38-bc96-593b42068dda tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:57.585513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bebd35cd-2e7f-4b38-bc96-593b42068dda tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:57.585936 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bebd35cd-2e7f-4b38-bc96-593b42068dda tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:57.599568 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-bebd35cd-2e7f-4b38-bc96-593b42068dda tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-bebd35cd-2e7f-4b38-bc96-593b42068dda tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 HTTP/1.1 Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:54:57.601224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:54:57.602724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:54:57.602724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:54:57.602724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:54:57.602724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:54:57.602724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:54:57.602724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:54:57.602724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:54:57.602724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:54:57.602724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:54:57.602724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:54:57.602724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:54:57.602724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': 'ff0a3b74-291b-4381-b945-50b48a823978'} Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:54:57.603484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:54:57.604665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:54:57.605690 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-bebd35cd-2e7f-4b38-bc96-593b42068dda tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 404 to user: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:54:57.605690 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-bebd35cd-2e7f-4b38-bc96-593b42068dda tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 404 len: 111 microversion: 2.1 time: 0.031191 Aug 24 16:54:57.605690 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 301/602] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:57 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:54:57.611298 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-928f5af0-9436-4f3b-9a82-c870f860ce28 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '.version_select at 0x7fa194a91b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:57.685855 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-928f5af0-9436-4f3b-9a82-c870f860ce28 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152618529" status: 202 len: 0 microversion: 2.1 time: 0.078198 Aug 24 16:54:57.686353 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 302/603] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Aug 24 16:54:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152618529 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:54:58.425670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-190fc932-618e-4290-a184-561d978e79d2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Action: 'create', calling method: .version_select at 0x7fa194a1faf0>, body: {"keypair": {"name": "tempest-keypair-1883323140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP70xIi916OjEElHuM7VKcYYcBugqLz95AHDhLcUWetxKA0Hm0jtx7V39FBeb6Baz20QA45G3HwYBM1w+zDFGskzvoz8kGKprNBu0u9yZ3g+GKctbpIuU8aDwWCfxWtp6Q=="}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:58.441281 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-190fc932-618e-4290-a184-561d978e79d2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for project 6b5b284e0b47422592057492601db382. Resources: {'key_pairs'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:54:58.445069 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-190fc932-618e-4290-a184-561d978e79d2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for user 88efd5eb09064aa2aa89e6d9580c6476 and project 6b5b284e0b47422592057492601db382. Resources: {'key_pairs'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:54:58.547349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-190fc932-618e-4290-a184-561d978e79d2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126341 Aug 24 16:54:58.547950 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 302/604] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Aug 24 16:54:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:00.787759 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-537060271", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4108caa5-f8d0-4511-be15-eaaba4ff32ab"}], "security_groups": [{"name": "tempest-securitygroup--41679062"}], "key_name": "tempest-keypair-1883323140", "user_data": "}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:00.887453 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] validate_networks() for [('4108caa5-f8d0-4511-be15-eaaba4ff32ab', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:55:01.254483 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:55:01.254913 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:55:01.255522 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:55:01.256102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:55:01.256602 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:55:01.266370 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:01.266916 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:01.267342 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:01.268168 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:01.268737 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:01.269196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:01.287453 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for project 6b5b284e0b47422592057492601db382. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:55:01.291666 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for user 88efd5eb09064aa2aa89e6d9580c6476 and project 6b5b284e0b47422592057492601db382. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:55:01.305255 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:55:01.305736 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:55:01.504128 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b8e72977-7dbd-41c5-9860-85138cda5e1e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.721052 Aug 24 16:55:01.504806 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 303/605] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:55:00 2022] POST /compute/v2.1/servers => generated 400 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:55:01.516189 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4142c558-398f-4baa-ab55-12861f4479f3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:01.528955 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4142c558-398f-4baa-ab55-12861f4479f3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:01.576853 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4142c558-398f-4baa-ab55-12861f4479f3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:01.585484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4142c558-398f-4baa-ab55-12861f4479f3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1241 microversion: 2.1 time: 0.073637 Aug 24 16:55:01.586053 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 303/606] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:01 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:02.607405 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d0b057e0-a193-4671-95fc-16819f8ba984 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:02.608025 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d0b057e0-a193-4671-95fc-16819f8ba984 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:02.615122 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0b057e0-a193-4671-95fc-16819f8ba984 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:02.615613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0b057e0-a193-4671-95fc-16819f8ba984 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:02.616081 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0b057e0-a193-4671-95fc-16819f8ba984 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:02.616807 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0b057e0-a193-4671-95fc-16819f8ba984 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:02.617259 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0b057e0-a193-4671-95fc-16819f8ba984 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:02.617683 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0b057e0-a193-4671-95fc-16819f8ba984 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:02.680718 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d0b057e0-a193-4671-95fc-16819f8ba984 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:02.688599 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d0b057e0-a193-4671-95fc-16819f8ba984 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1237 microversion: 2.1 time: 0.085532 Aug 24 16:55:02.689174 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 304/607] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:02 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:03.721108 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d0f76df8-3160-4a68-ba30-41f573ccf0ca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:03.721652 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d0f76df8-3160-4a68-ba30-41f573ccf0ca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:03.728240 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d0f76df8-3160-4a68-ba30-41f573ccf0ca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:03.728763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d0f76df8-3160-4a68-ba30-41f573ccf0ca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:03.731078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d0f76df8-3160-4a68-ba30-41f573ccf0ca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:03.731078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d0f76df8-3160-4a68-ba30-41f573ccf0ca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:03.731078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d0f76df8-3160-4a68-ba30-41f573ccf0ca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:03.731078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d0f76df8-3160-4a68-ba30-41f573ccf0ca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:03.794272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d0f76df8-3160-4a68-ba30-41f573ccf0ca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:03.802429 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d0f76df8-3160-4a68-ba30-41f573ccf0ca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1311 microversion: 2.1 time: 0.085781 Aug 24 16:55:03.803101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 304/608] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:03 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:04.824461 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-45c4b11d-e590-4e9c-955c-318c7e659c8e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:04.825091 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-45c4b11d-e590-4e9c-955c-318c7e659c8e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:04.831689 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45c4b11d-e590-4e9c-955c-318c7e659c8e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:04.832180 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45c4b11d-e590-4e9c-955c-318c7e659c8e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:04.832667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45c4b11d-e590-4e9c-955c-318c7e659c8e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:04.833369 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45c4b11d-e590-4e9c-955c-318c7e659c8e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:04.833829 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45c4b11d-e590-4e9c-955c-318c7e659c8e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:04.834258 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45c4b11d-e590-4e9c-955c-318c7e659c8e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:04.965742 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-45c4b11d-e590-4e9c-955c-318c7e659c8e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:04.973842 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-45c4b11d-e590-4e9c-955c-318c7e659c8e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1365 microversion: 2.1 time: 0.153287 Aug 24 16:55:04.974425 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 305/609] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:04 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:05.273786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-a48fcac3-ff8e-4045-bfa4-feb10a745e8c req-6d119a1f-1630-4701-baba-c365724a87a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f7a331-c982-4209-87fb-bf041c901c56", "tag": "e8853a68-efa6-4529-b0a1-5cf984b3c130"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:05.284037 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-a48fcac3-ff8e-4045-bfa4-feb10a745e8c req-6d119a1f-1630-4701-baba-c365724a87a5 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:05.284614 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-a48fcac3-ff8e-4045-bfa4-feb10a745e8c req-6d119a1f-1630-4701-baba-c365724a87a5 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:05.285048 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-a48fcac3-ff8e-4045-bfa4-feb10a745e8c req-6d119a1f-1630-4701-baba-c365724a87a5 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:05.295709 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-a48fcac3-ff8e-4045-bfa4-feb10a745e8c req-6d119a1f-1630-4701-baba-c365724a87a5 service nova] Creating event network-changed:e8853a68-efa6-4529-b0a1-5cf984b3c130 for instance 80f7a331-c982-4209-87fb-bf041c901c56 on hv-cinder-85220 Aug 24 16:55:05.300600 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-a48fcac3-ff8e-4045-bfa4-feb10a745e8c req-6d119a1f-1630-4701-baba-c365724a87a5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030407 Aug 24 16:55:05.301195 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 305/610] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:55:05.995341 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cd3eb889-83b2-4d9a-aba4-c7493e45b301 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:05.995956 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cd3eb889-83b2-4d9a-aba4-c7493e45b301 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:06.002790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cd3eb889-83b2-4d9a-aba4-c7493e45b301 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:06.003539 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cd3eb889-83b2-4d9a-aba4-c7493e45b301 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:06.004375 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cd3eb889-83b2-4d9a-aba4-c7493e45b301 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:06.005127 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cd3eb889-83b2-4d9a-aba4-c7493e45b301 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:06.006187 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cd3eb889-83b2-4d9a-aba4-c7493e45b301 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:06.006625 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cd3eb889-83b2-4d9a-aba4-c7493e45b301 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:06.138111 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cd3eb889-83b2-4d9a-aba4-c7493e45b301 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:06.141615 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:06.146640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cd3eb889-83b2-4d9a-aba4-c7493e45b301 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1365 microversion: 2.1 time: 0.155251 Aug 24 16:55:06.147209 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 306/611] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:05 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:07.168781 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f5eb221a-82de-441d-ac06-fcf7c6e1dd5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:07.169516 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f5eb221a-82de-441d-ac06-fcf7c6e1dd5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:07.175670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f5eb221a-82de-441d-ac06-fcf7c6e1dd5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:07.176163 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f5eb221a-82de-441d-ac06-fcf7c6e1dd5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:07.176628 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f5eb221a-82de-441d-ac06-fcf7c6e1dd5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:07.177321 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f5eb221a-82de-441d-ac06-fcf7c6e1dd5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:07.177778 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f5eb221a-82de-441d-ac06-fcf7c6e1dd5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:07.178205 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f5eb221a-82de-441d-ac06-fcf7c6e1dd5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:07.302214 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f5eb221a-82de-441d-ac06-fcf7c6e1dd5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:07.309814 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f5eb221a-82de-441d-ac06-fcf7c6e1dd5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1365 microversion: 2.1 time: 0.145830 Aug 24 16:55:07.310368 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 306/612] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:07 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:08.331042 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-84b619f2-0c57-4071-a826-012f67663098 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:08.331580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-84b619f2-0c57-4071-a826-012f67663098 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:08.339027 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84b619f2-0c57-4071-a826-012f67663098 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:08.339513 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84b619f2-0c57-4071-a826-012f67663098 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:08.339945 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84b619f2-0c57-4071-a826-012f67663098 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:08.340658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84b619f2-0c57-4071-a826-012f67663098 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:08.341110 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84b619f2-0c57-4071-a826-012f67663098 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:08.341529 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84b619f2-0c57-4071-a826-012f67663098 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:08.472694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-84b619f2-0c57-4071-a826-012f67663098 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:08.480976 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-84b619f2-0c57-4071-a826-012f67663098 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1365 microversion: 2.1 time: 0.153853 Aug 24 16:55:08.481542 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 307/613] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:08 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:09.501441 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5a9df008-bd81-42c0-bca7-39cfa344b7f2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:09.502054 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5a9df008-bd81-42c0-bca7-39cfa344b7f2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:09.508868 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5a9df008-bd81-42c0-bca7-39cfa344b7f2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:09.509354 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5a9df008-bd81-42c0-bca7-39cfa344b7f2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:09.510206 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5a9df008-bd81-42c0-bca7-39cfa344b7f2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:09.510525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5a9df008-bd81-42c0-bca7-39cfa344b7f2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:09.510981 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5a9df008-bd81-42c0-bca7-39cfa344b7f2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:09.511408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5a9df008-bd81-42c0-bca7-39cfa344b7f2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:09.642591 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-5a9df008-bd81-42c0-bca7-39cfa344b7f2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:09.650460 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5a9df008-bd81-42c0-bca7-39cfa344b7f2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1365 microversion: 2.1 time: 0.152825 Aug 24 16:55:09.651339 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 307/614] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:09 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:10.465785 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-85fd6e2c-3876-4610-ac90-7c6676918e9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:10.466368 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-85fd6e2c-3876-4610-ac90-7c6676918e9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:10.472672 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85fd6e2c-3876-4610-ac90-7c6676918e9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:10.473147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85fd6e2c-3876-4610-ac90-7c6676918e9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:10.473569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85fd6e2c-3876-4610-ac90-7c6676918e9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:10.474245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85fd6e2c-3876-4610-ac90-7c6676918e9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:10.474689 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85fd6e2c-3876-4610-ac90-7c6676918e9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:10.475103 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85fd6e2c-3876-4610-ac90-7c6676918e9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:10.503691 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-85fd6e2c-3876-4610-ac90-7c6676918e9b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-volume_attachments/a49142fc-1b41-4d9c-a703-87a67bca1d88" status: 200 len: 194 microversion: 2.20 time: 0.041706 Aug 24 16:55:10.504258 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 308/615] 10.222.0.70 () {60 vars in 1454 bytes} [Wed Aug 24 16:55:10 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-volume_attachments/a49142fc-1b41-4d9c-a703-87a67bca1d88 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:55:10.570864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1bd2a356-d7a3-482c-a33a-bec2e22fc4d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:10.571397 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1bd2a356-d7a3-482c-a33a-bec2e22fc4d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:10.584018 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1bd2a356-d7a3-482c-a33a-bec2e22fc4d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:10.586613 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1bd2a356-d7a3-482c-a33a-bec2e22fc4d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:10.587225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1bd2a356-d7a3-482c-a33a-bec2e22fc4d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:10.588106 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1bd2a356-d7a3-482c-a33a-bec2e22fc4d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:10.588764 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1bd2a356-d7a3-482c-a33a-bec2e22fc4d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:10.589377 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1bd2a356-d7a3-482c-a33a-bec2e22fc4d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:10.671246 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6c0b05c1-a28b-499a-97ba-00d9418ce333 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:10.672014 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6c0b05c1-a28b-499a-97ba-00d9418ce333 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:10.678558 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c0b05c1-a28b-499a-97ba-00d9418ce333 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:10.679039 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c0b05c1-a28b-499a-97ba-00d9418ce333 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:10.679648 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c0b05c1-a28b-499a-97ba-00d9418ce333 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:10.680347 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c0b05c1-a28b-499a-97ba-00d9418ce333 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:10.681072 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c0b05c1-a28b-499a-97ba-00d9418ce333 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:10.681512 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c0b05c1-a28b-499a-97ba-00d9418ce333 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:10.684290 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-1bd2a356-d7a3-482c-a33a-bec2e22fc4d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lazy-loading 'services' on Instance uuid 6d2cca9b-5df9-43a4-9791-633eab746eeb {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:55:10.818912 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6c0b05c1-a28b-499a-97ba-00d9418ce333 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:10.827711 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6c0b05c1-a28b-499a-97ba-00d9418ce333 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1365 microversion: 2.1 time: 0.160429 Aug 24 16:55:10.828318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 309/616] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:10 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:10.970075 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1bd2a356-d7a3-482c-a33a-bec2e22fc4d5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-volume_attachments/a49142fc-1b41-4d9c-a703-87a67bca1d88" status: 202 len: 0 microversion: 2.20 time: 0.403484 Aug 24 16:55:10.970748 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 308/617] 10.222.0.70 () {60 vars in 1457 bytes} [Wed Aug 24 16:55:10 2022] DELETE /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-volume_attachments/a49142fc-1b41-4d9c-a703-87a67bca1d88 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:10.987221 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e84a9029-d019-461d-b65d-a63560a4b44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:10.992205 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e84a9029-d019-461d-b65d-a63560a4b44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:11.000929 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e84a9029-d019-461d-b65d-a63560a4b44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:11.001333 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e84a9029-d019-461d-b65d-a63560a4b44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:11.001765 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e84a9029-d019-461d-b65d-a63560a4b44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:11.002742 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e84a9029-d019-461d-b65d-a63560a4b44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:11.004477 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e84a9029-d019-461d-b65d-a63560a4b44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:11.005238 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e84a9029-d019-461d-b65d-a63560a4b44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:11.039702 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e84a9029-d019-461d-b65d-a63560a4b44c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054601 Aug 24 16:55:11.040292 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 310/618] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Aug 24 16:55:10 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:55:11.848674 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5f70120c-69d9-44f8-9cd9-69ad3d053027 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:11.849414 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5f70120c-69d9-44f8-9cd9-69ad3d053027 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:11.851769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=6 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:11.856875 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5f70120c-69d9-44f8-9cd9-69ad3d053027 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:11.857299 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5f70120c-69d9-44f8-9cd9-69ad3d053027 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:11.857851 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5f70120c-69d9-44f8-9cd9-69ad3d053027 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:11.858447 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5f70120c-69d9-44f8-9cd9-69ad3d053027 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:11.858902 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5f70120c-69d9-44f8-9cd9-69ad3d053027 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:11.859334 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5f70120c-69d9-44f8-9cd9-69ad3d053027 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:11.989673 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-5f70120c-69d9-44f8-9cd9-69ad3d053027 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:11.997993 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5f70120c-69d9-44f8-9cd9-69ad3d053027 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1365 microversion: 2.1 time: 0.153572 Aug 24 16:55:11.998667 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 309/619] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:11 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:12.053348 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e7bddf63-bd07-4925-a940-f19fa93462b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:12.055502 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e7bddf63-bd07-4925-a940-f19fa93462b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:12.057366 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:12.058134 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=6 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:12.063346 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7bddf63-bd07-4925-a940-f19fa93462b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:12.063861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7bddf63-bd07-4925-a940-f19fa93462b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:12.064297 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7bddf63-bd07-4925-a940-f19fa93462b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:12.065022 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7bddf63-bd07-4925-a940-f19fa93462b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:12.065477 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7bddf63-bd07-4925-a940-f19fa93462b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:12.065901 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7bddf63-bd07-4925-a940-f19fa93462b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:12.095678 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e7bddf63-bd07-4925-a940-f19fa93462b7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047086 Aug 24 16:55:12.096230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 311/620] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Aug 24 16:55:12 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:55:13.019582 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6f975782-734f-43a1-aff3-2fdd988194ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:13.023902 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6f975782-734f-43a1-aff3-2fdd988194ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:13.026771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6f975782-734f-43a1-aff3-2fdd988194ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:13.027264 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6f975782-734f-43a1-aff3-2fdd988194ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:13.027706 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6f975782-734f-43a1-aff3-2fdd988194ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:13.028427 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6f975782-734f-43a1-aff3-2fdd988194ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:13.028890 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6f975782-734f-43a1-aff3-2fdd988194ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:13.029322 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6f975782-734f-43a1-aff3-2fdd988194ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:13.109015 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1e839cb9-77ee-47bb-a32e-6c572af15074 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:13.111188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1e839cb9-77ee-47bb-a32e-6c572af15074 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:13.119516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e839cb9-77ee-47bb-a32e-6c572af15074 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:13.119860 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e839cb9-77ee-47bb-a32e-6c572af15074 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:13.120294 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e839cb9-77ee-47bb-a32e-6c572af15074 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:13.121269 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e839cb9-77ee-47bb-a32e-6c572af15074 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:13.121671 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e839cb9-77ee-47bb-a32e-6c572af15074 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:13.122101 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e839cb9-77ee-47bb-a32e-6c572af15074 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:13.151949 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1e839cb9-77ee-47bb-a32e-6c572af15074 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047487 Aug 24 16:55:13.152601 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 312/621] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Aug 24 16:55:13 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:13.171651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6f975782-734f-43a1-aff3-2fdd988194ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:13.180082 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6f975782-734f-43a1-aff3-2fdd988194ff tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1365 microversion: 2.1 time: 0.164485 Aug 24 16:55:13.180865 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 310/622] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:13 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:13.214995 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-f5260e50-75cc-46d3-90f1-a37e03766321 req-233a90de-e6d5-4f20-a78c-bf17bd0a4993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f7a331-c982-4209-87fb-bf041c901c56", "name": "network-vif-plugged", "status": "completed", "tag": "e8853a68-efa6-4529-b0a1-5cf984b3c130"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:13.224204 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-f5260e50-75cc-46d3-90f1-a37e03766321 req-233a90de-e6d5-4f20-a78c-bf17bd0a4993 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:13.225267 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-f5260e50-75cc-46d3-90f1-a37e03766321 req-233a90de-e6d5-4f20-a78c-bf17bd0a4993 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:13.225756 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-f5260e50-75cc-46d3-90f1-a37e03766321 req-233a90de-e6d5-4f20-a78c-bf17bd0a4993 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:13.226428 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d8744c0d-0849-40ed-b9cc-4268ec43358b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:13.226915 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d8744c0d-0849-40ed-b9cc-4268ec43358b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:13.232720 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8744c0d-0849-40ed-b9cc-4268ec43358b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:13.233199 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8744c0d-0849-40ed-b9cc-4268ec43358b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:13.233710 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8744c0d-0849-40ed-b9cc-4268ec43358b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:13.234392 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8744c0d-0849-40ed-b9cc-4268ec43358b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:13.234843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8744c0d-0849-40ed-b9cc-4268ec43358b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:13.235259 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8744c0d-0849-40ed-b9cc-4268ec43358b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:13.236783 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-f5260e50-75cc-46d3-90f1-a37e03766321 req-233a90de-e6d5-4f20-a78c-bf17bd0a4993 service nova] Creating event network-vif-plugged:e8853a68-efa6-4529-b0a1-5cf984b3c130 for instance 80f7a331-c982-4209-87fb-bf041c901c56 on hv-cinder-85220 Aug 24 16:55:13.242479 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-f5260e50-75cc-46d3-90f1-a37e03766321 req-233a90de-e6d5-4f20-a78c-bf17bd0a4993 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088735 Aug 24 16:55:13.243230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 313/623] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:13.261456 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d8744c0d-0849-40ed-b9cc-4268ec43358b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Going to try to terminate instance {{(pid=127715) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:55:13.290064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:13.657003 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d8744c0d-0849-40ed-b9cc-4268ec43358b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 204 len: 0 microversion: 2.20 time: 0.434435 Aug 24 16:55:13.657684 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 311/624] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Aug 24 16:55:13 2022] DELETE /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 16:55:13.667231 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3d699ada-6e8b-4571-898e-59ea222eb7b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:13.667937 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3d699ada-6e8b-4571-898e-59ea222eb7b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:13.674134 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3d699ada-6e8b-4571-898e-59ea222eb7b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:13.674619 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3d699ada-6e8b-4571-898e-59ea222eb7b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:13.675053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3d699ada-6e8b-4571-898e-59ea222eb7b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:13.675740 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3d699ada-6e8b-4571-898e-59ea222eb7b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:13.676195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3d699ada-6e8b-4571-898e-59ea222eb7b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:13.676662 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3d699ada-6e8b-4571-898e-59ea222eb7b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:13.806801 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3d699ada-6e8b-4571-898e-59ea222eb7b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:13.815054 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3d699ada-6e8b-4571-898e-59ea222eb7b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:13.816618 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3d699ada-6e8b-4571-898e-59ea222eb7b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:13.817781 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3d699ada-6e8b-4571-898e-59ea222eb7b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.155608 Aug 24 16:55:13.818338 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 314/625] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:13 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:14.204070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ac58e80e-b184-48a7-959e-d02a917f4e26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:14.204799 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ac58e80e-b184-48a7-959e-d02a917f4e26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:14.211433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ac58e80e-b184-48a7-959e-d02a917f4e26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:14.211924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ac58e80e-b184-48a7-959e-d02a917f4e26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:14.212365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ac58e80e-b184-48a7-959e-d02a917f4e26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:14.213100 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ac58e80e-b184-48a7-959e-d02a917f4e26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:14.213557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ac58e80e-b184-48a7-959e-d02a917f4e26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:14.214015 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ac58e80e-b184-48a7-959e-d02a917f4e26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:14.345680 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ac58e80e-b184-48a7-959e-d02a917f4e26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:14.353311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ac58e80e-b184-48a7-959e-d02a917f4e26 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1365 microversion: 2.1 time: 0.153467 Aug 24 16:55:14.356061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 312/626] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:14 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:14.841234 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d82fc027-5220-43ac-9013-e30f61efa368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:14.841760 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d82fc027-5220-43ac-9013-e30f61efa368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:14.848103 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d82fc027-5220-43ac-9013-e30f61efa368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:14.848616 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d82fc027-5220-43ac-9013-e30f61efa368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:14.849048 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d82fc027-5220-43ac-9013-e30f61efa368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:14.849723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d82fc027-5220-43ac-9013-e30f61efa368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:14.850165 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d82fc027-5220-43ac-9013-e30f61efa368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:14.850578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d82fc027-5220-43ac-9013-e30f61efa368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:14.978702 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d82fc027-5220-43ac-9013-e30f61efa368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:14.986731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d82fc027-5220-43ac-9013-e30f61efa368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:14.988206 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d82fc027-5220-43ac-9013-e30f61efa368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:14.989375 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d82fc027-5220-43ac-9013-e30f61efa368 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.152085 Aug 24 16:55:14.989918 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 315/627] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:14 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:15.374809 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4ed5f022-1b9d-4a8d-91d6-d79e35b798e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:15.381715 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4ed5f022-1b9d-4a8d-91d6-d79e35b798e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:15.381715 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:15.383296 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ed5f022-1b9d-4a8d-91d6-d79e35b798e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:15.383785 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ed5f022-1b9d-4a8d-91d6-d79e35b798e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:15.384228 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ed5f022-1b9d-4a8d-91d6-d79e35b798e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:15.384986 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ed5f022-1b9d-4a8d-91d6-d79e35b798e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:15.385447 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ed5f022-1b9d-4a8d-91d6-d79e35b798e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:15.385876 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ed5f022-1b9d-4a8d-91d6-d79e35b798e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:15.514610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4ed5f022-1b9d-4a8d-91d6-d79e35b798e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:15.522375 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4ed5f022-1b9d-4a8d-91d6-d79e35b798e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1365 microversion: 2.1 time: 0.151559 Aug 24 16:55:15.523449 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 313/628] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:15 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:16.013057 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f2d086fe-0c09-4da8-a320-2fbd64f151ca tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:16.013594 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f2d086fe-0c09-4da8-a320-2fbd64f151ca tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:16.015993 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:16.020641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2d086fe-0c09-4da8-a320-2fbd64f151ca tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:16.021151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2d086fe-0c09-4da8-a320-2fbd64f151ca tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:16.021580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2d086fe-0c09-4da8-a320-2fbd64f151ca tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:16.022262 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2d086fe-0c09-4da8-a320-2fbd64f151ca tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:16.022711 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2d086fe-0c09-4da8-a320-2fbd64f151ca tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:16.023640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f2d086fe-0c09-4da8-a320-2fbd64f151ca tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:16.154644 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f2d086fe-0c09-4da8-a320-2fbd64f151ca tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:16.162558 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f2d086fe-0c09-4da8-a320-2fbd64f151ca tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:16.164037 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f2d086fe-0c09-4da8-a320-2fbd64f151ca tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:16.165210 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f2d086fe-0c09-4da8-a320-2fbd64f151ca tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1723 microversion: 2.20 time: 0.156127 Aug 24 16:55:16.165762 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 316/629] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:16 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:16.543600 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-615ab70a-8d90-4293-b377-0490face0fb1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:16.544222 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-615ab70a-8d90-4293-b377-0490face0fb1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:16.550810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-615ab70a-8d90-4293-b377-0490face0fb1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:16.551297 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-615ab70a-8d90-4293-b377-0490face0fb1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:16.551740 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-615ab70a-8d90-4293-b377-0490face0fb1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:16.552485 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-615ab70a-8d90-4293-b377-0490face0fb1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:16.552960 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-615ab70a-8d90-4293-b377-0490face0fb1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:16.553387 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-615ab70a-8d90-4293-b377-0490face0fb1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:16.695591 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-615ab70a-8d90-4293-b377-0490face0fb1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:16.696794 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-615ab70a-8d90-4293-b377-0490face0fb1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1365 microversion: 2.1 time: 0.157441 Aug 24 16:55:16.697370 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 314/630] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:16 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:17.104072 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-b215b431-a962-4759-9c46-1a8fcb3dc969 req-21f69b42-521f-4a11-9a1b-ae6ed14c794e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2cca9b-5df9-43a4-9791-633eab746eeb", "name": "network-vif-deleted", "tag": "de8a2ec3-3c1d-4c19-9833-a7a754e2b815"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:17.110065 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-b215b431-a962-4759-9c46-1a8fcb3dc969 req-21f69b42-521f-4a11-9a1b-ae6ed14c794e service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:17.110643 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-b215b431-a962-4759-9c46-1a8fcb3dc969 req-21f69b42-521f-4a11-9a1b-ae6ed14c794e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:17.111190 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-b215b431-a962-4759-9c46-1a8fcb3dc969 req-21f69b42-521f-4a11-9a1b-ae6ed14c794e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:17.123758 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-b215b431-a962-4759-9c46-1a8fcb3dc969 req-21f69b42-521f-4a11-9a1b-ae6ed14c794e service nova] Creating event network-vif-deleted:de8a2ec3-3c1d-4c19-9833-a7a754e2b815 for instance 6d2cca9b-5df9-43a4-9791-633eab746eeb on hv-cinder-85220 Aug 24 16:55:17.129830 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-b215b431-a962-4759-9c46-1a8fcb3dc969 req-21f69b42-521f-4a11-9a1b-ae6ed14c794e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035570 Aug 24 16:55:17.132984 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 317/631] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:17.187373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-df0dbb6c-2d29-47f1-b02a-fadc96ef3d53 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:17.187988 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-df0dbb6c-2d29-47f1-b02a-fadc96ef3d53 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:17.196255 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df0dbb6c-2d29-47f1-b02a-fadc96ef3d53 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:17.201955 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df0dbb6c-2d29-47f1-b02a-fadc96ef3d53 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:17.201955 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df0dbb6c-2d29-47f1-b02a-fadc96ef3d53 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:17.201955 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df0dbb6c-2d29-47f1-b02a-fadc96ef3d53 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:17.201955 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df0dbb6c-2d29-47f1-b02a-fadc96ef3d53 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:17.202356 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df0dbb6c-2d29-47f1-b02a-fadc96ef3d53 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:17.285507 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-df0dbb6c-2d29-47f1-b02a-fadc96ef3d53 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:17.295987 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-df0dbb6c-2d29-47f1-b02a-fadc96ef3d53 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:17.297774 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-df0dbb6c-2d29-47f1-b02a-fadc96ef3d53 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:17.299133 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-df0dbb6c-2d29-47f1-b02a-fadc96ef3d53 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 200 len: 1656 microversion: 2.20 time: 0.115919 Aug 24 16:55:17.300207 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 315/632] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:17 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 1656 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:17.718427 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-57df8ccd-4950-4a6e-a35d-f8329ea7ef5d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:17.719128 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-57df8ccd-4950-4a6e-a35d-f8329ea7ef5d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:17.725818 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57df8ccd-4950-4a6e-a35d-f8329ea7ef5d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:17.726934 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57df8ccd-4950-4a6e-a35d-f8329ea7ef5d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:17.727367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57df8ccd-4950-4a6e-a35d-f8329ea7ef5d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:17.728077 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57df8ccd-4950-4a6e-a35d-f8329ea7ef5d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:17.728557 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57df8ccd-4950-4a6e-a35d-f8329ea7ef5d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:17.728979 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57df8ccd-4950-4a6e-a35d-f8329ea7ef5d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:17.871753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-57df8ccd-4950-4a6e-a35d-f8329ea7ef5d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:17.880284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-57df8ccd-4950-4a6e-a35d-f8329ea7ef5d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1555 microversion: 2.1 time: 0.166143 Aug 24 16:55:17.880887 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 318/633] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:17 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:17.901355 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e9446500-4194-45fa-832f-61505f8090d9 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:17.905249 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e9446500-4194-45fa-832f-61505f8090d9 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:17.908466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e9446500-4194-45fa-832f-61505f8090d9 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:17.908948 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e9446500-4194-45fa-832f-61505f8090d9 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:17.909409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e9446500-4194-45fa-832f-61505f8090d9 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:17.910096 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e9446500-4194-45fa-832f-61505f8090d9 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:17.910546 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e9446500-4194-45fa-832f-61505f8090d9 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:17.910972 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e9446500-4194-45fa-832f-61505f8090d9 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:17.990048 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e9446500-4194-45fa-832f-61505f8090d9 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093182 Aug 24 16:55:17.990645 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 316/634] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Aug 24 16:55:17 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:18.325763 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bf050826-97ce-4d8c-b962-bd1d8110a283 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:18.326367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bf050826-97ce-4d8c-b962-bd1d8110a283 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:18.332818 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf050826-97ce-4d8c-b962-bd1d8110a283 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:18.333302 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf050826-97ce-4d8c-b962-bd1d8110a283 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:18.333751 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf050826-97ce-4d8c-b962-bd1d8110a283 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:18.334423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf050826-97ce-4d8c-b962-bd1d8110a283 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:18.334875 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf050826-97ce-4d8c-b962-bd1d8110a283 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:18.335299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf050826-97ce-4d8c-b962-bd1d8110a283 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:18.348410 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-bf050826-97ce-4d8c-b962-bd1d8110a283 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] HTTP exception thrown: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bf050826-97ce-4d8c-b962-bd1d8110a283 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Request method failure captured: Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb HTTP/1.1 Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZIhr_tQl-FTbFiyNprlO4a6lKjXiWGrd3wNwayCJKIjOaIVm0DC5kqqAaS76RQJN2HsYKEXLdCg9q1Z_cHpw13WUmGkfO5QkYG0dys3ww6K3KGwOB1lv3LoDLq-Z-oZ2oCnqaL3x7k3LIAVD0s8SN4hZOljeUBdbbmLmCHWuW8BXA Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 525245253a2d49c48ef009a4d6c3cd51 Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:55:18.350051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:55:18.352071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:55:18.352071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 16:55:18.352071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 525245253a2d49c48ef009a4d6c3cd51 Aug 24 16:55:18.352071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 16:55:18.352071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-AttachVolumeShelveTestJSON-1732562792-project Aug 24 16:55:18.352071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:55:18.352071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:55:18.352071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 7a930257a6584b04bae278aa83940264 Aug 24 16:55:18.352071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1732562792-project Aug 24 16:55:18.352071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:55:18.352071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 16:55:18.352071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '6d2cca9b-5df9-43a4-9791-633eab746eeb'} Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:18.353082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 16:55:18.354585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:55:18.356245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bf050826-97ce-4d8c-b962-bd1d8110a283 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Returning 404 to user: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:18.356245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bf050826-97ce-4d8c-b962-bd1d8110a283 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 404 len: 111 microversion: 2.20 time: 0.030127 Aug 24 16:55:18.356245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 319/635] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:18 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:55:18.361215 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-076067b0-3e78-4cfc-8fc8-bf827053046a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '.version_select at 0x7fa194a48f70>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:18.440670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-076067b0-3e78-4cfc-8fc8-bf827053046a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429959760" status: 204 len: 0 microversion: 2.20 time: 0.083277 Aug 24 16:55:18.441440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 317/636] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Aug 24 16:55:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429959760 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:55:19.144943 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-b89f23a3-d845-4013-a22c-0c6930b9d864 req-1cc075f6-1cdc-4e9e-909d-7fbdc05dff96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f7a331-c982-4209-87fb-bf041c901c56", "tag": "e8853a68-efa6-4529-b0a1-5cf984b3c130"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:19.154232 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-b89f23a3-d845-4013-a22c-0c6930b9d864 req-1cc075f6-1cdc-4e9e-909d-7fbdc05dff96 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:19.154785 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-b89f23a3-d845-4013-a22c-0c6930b9d864 req-1cc075f6-1cdc-4e9e-909d-7fbdc05dff96 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:19.155295 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-b89f23a3-d845-4013-a22c-0c6930b9d864 req-1cc075f6-1cdc-4e9e-909d-7fbdc05dff96 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:19.166853 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-b89f23a3-d845-4013-a22c-0c6930b9d864 req-1cc075f6-1cdc-4e9e-909d-7fbdc05dff96 service nova] Creating event network-changed:e8853a68-efa6-4529-b0a1-5cf984b3c130 for instance 80f7a331-c982-4209-87fb-bf041c901c56 on hv-cinder-85220 Aug 24 16:55:19.171793 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-b89f23a3-d845-4013-a22c-0c6930b9d864 req-1cc075f6-1cdc-4e9e-909d-7fbdc05dff96 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030604 Aug 24 16:55:19.172737 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 320/637] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:19.550761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-dcc5faef-0d62-4367-ba46-c44688bf3433 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Action: 'create', calling method: .version_select at 0x7fa19497c790>, body: {"keypair": {"name": "tempest-keypair-1522251124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlApWhIcP5AEfmWr8Ms0nN2W1XVoQyZyRQrcQLB5De0fnmklCRPjjvcjMX+47sL1LzTxZ+iQQXI95kOovtC2fch3QOpZmE3D8F8Ls114ExSXlnbeqedai1KBID6UBVB+A=="}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:19.573054 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-dcc5faef-0d62-4367-ba46-c44688bf3433 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Getting quotas for project 525245253a2d49c48ef009a4d6c3cd51. Resources: {'key_pairs'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:55:19.577042 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-dcc5faef-0d62-4367-ba46-c44688bf3433 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Getting quotas for user 7a930257a6584b04bae278aa83940264 and project 525245253a2d49c48ef009a4d6c3cd51. Resources: {'key_pairs'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:55:19.658056 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-dcc5faef-0d62-4367-ba46-c44688bf3433 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.114128 Aug 24 16:55:19.661161 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 318/638] 10.222.0.70 () {62 vars in 1200 bytes} [Wed Aug 24 16:55:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 16:55:20.307073 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-71b5299c-f947-4a0f-84fb-d3052d85e53e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:20.307636 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-71b5299c-f947-4a0f-84fb-d3052d85e53e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:20.313793 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71b5299c-f947-4a0f-84fb-d3052d85e53e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:20.314269 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71b5299c-f947-4a0f-84fb-d3052d85e53e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:20.314698 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71b5299c-f947-4a0f-84fb-d3052d85e53e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:20.315386 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71b5299c-f947-4a0f-84fb-d3052d85e53e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:20.315836 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71b5299c-f947-4a0f-84fb-d3052d85e53e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:20.316258 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71b5299c-f947-4a0f-84fb-d3052d85e53e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:20.398485 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-71b5299c-f947-4a0f-84fb-d3052d85e53e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lazy-loading 'services' on Instance uuid 84ecc526-a083-4f47-ac70-0b06d5b66158 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:55:20.659529 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-71b5299c-f947-4a0f-84fb-d3052d85e53e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "DELETE /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-volume_attachments/8729176a-3c8d-4f1b-bf15-1fd9d8be916f" status: 202 len: 0 microversion: 2.1 time: 0.357411 Aug 24 16:55:20.660158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 321/639] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Aug 24 16:55:20 2022] DELETE /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-volume_attachments/8729176a-3c8d-4f1b-bf15-1fd9d8be916f => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:55:20.670070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2935fbec-8e80-4abf-9d8b-d2cdb14d42f3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:20.672293 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2935fbec-8e80-4abf-9d8b-d2cdb14d42f3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:20.678233 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2935fbec-8e80-4abf-9d8b-d2cdb14d42f3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:20.678771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2935fbec-8e80-4abf-9d8b-d2cdb14d42f3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:20.679212 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2935fbec-8e80-4abf-9d8b-d2cdb14d42f3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:20.680595 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2935fbec-8e80-4abf-9d8b-d2cdb14d42f3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:20.681047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2935fbec-8e80-4abf-9d8b-d2cdb14d42f3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:20.681469 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2935fbec-8e80-4abf-9d8b-d2cdb14d42f3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:20.712758 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2935fbec-8e80-4abf-9d8b-d2cdb14d42f3 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046803 Aug 24 16:55:20.713279 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 319/640] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:55:20 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:21.725430 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-141d491a-90c8-4a18-9176-b0f486f7588b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:21.728750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-141d491a-90c8-4a18-9176-b0f486f7588b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:21.735746 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-141d491a-90c8-4a18-9176-b0f486f7588b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:21.736307 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-141d491a-90c8-4a18-9176-b0f486f7588b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:21.736833 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-141d491a-90c8-4a18-9176-b0f486f7588b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:21.737622 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-141d491a-90c8-4a18-9176-b0f486f7588b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:21.738184 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-141d491a-90c8-4a18-9176-b0f486f7588b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:21.738661 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-141d491a-90c8-4a18-9176-b0f486f7588b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:21.769241 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-141d491a-90c8-4a18-9176-b0f486f7588b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047937 Aug 24 16:55:21.769790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 322/641] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:55:21 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:22.073141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1212817993", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6feb1e1a-254e-49ca-8dd8-13cc9f9704e2"}], "security_groups": [{"name": "tempest-securitygroup--467656356"}], "key_name": "tempest-keypair-1522251124", "user_data": "}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:22.173612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.network.neutron [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] validate_networks() for [('6feb1e1a-254e-49ca-8dd8-13cc9f9704e2', None, None, None, None, None)] {{(pid=127715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:55:22.584061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Flavor limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:55:22.584061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Image limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:55:22.584061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Flavor pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:55:22.584061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Image pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:55:22.584061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:55:22.592922 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:22.593409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:22.593847 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:22.594580 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:22.595095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:22.595568 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:22.613157 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Getting quotas for project 525245253a2d49c48ef009a4d6c3cd51. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:55:22.617245 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Getting quotas for user 7a930257a6584b04bae278aa83940264 and project 525245253a2d49c48ef009a4d6c3cd51. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:55:22.628144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Going to run 1 instances... {{(pid=127715) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:55:22.630708 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:55:22.780810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e97dd3a3-f8d9-40d4-ba45-6455646bf062 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:22.782958 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e97dd3a3-f8d9-40d4-ba45-6455646bf062 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:22.789480 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e97dd3a3-f8d9-40d4-ba45-6455646bf062 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:22.789959 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e97dd3a3-f8d9-40d4-ba45-6455646bf062 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:22.790415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e97dd3a3-f8d9-40d4-ba45-6455646bf062 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:22.791101 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e97dd3a3-f8d9-40d4-ba45-6455646bf062 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:22.791548 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e97dd3a3-f8d9-40d4-ba45-6455646bf062 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:22.791965 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e97dd3a3-f8d9-40d4-ba45-6455646bf062 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:22.805910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-20bef246-8517-4bda-8c51-549e6483ce65 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.737131 Aug 24 16:55:22.806921 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 320/642] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Aug 24 16:55:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 16:55:22.817956 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a4202c7c-7cb0-453d-8ad2-87abec1ec063 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:22.818573 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a4202c7c-7cb0-453d-8ad2-87abec1ec063 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:22.821851 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e97dd3a3-f8d9-40d4-ba45-6455646bf062 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044961 Aug 24 16:55:22.824054 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 323/643] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:55:22 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 16:55:22.874771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a4202c7c-7cb0-453d-8ad2-87abec1ec063 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:22.883589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a4202c7c-7cb0-453d-8ad2-87abec1ec063 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:22.885129 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a4202c7c-7cb0-453d-8ad2-87abec1ec063 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:22.886229 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a4202c7c-7cb0-453d-8ad2-87abec1ec063 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1282 microversion: 2.20 time: 0.072497 Aug 24 16:55:22.886775 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 321/644] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:22 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:22.901334 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-596ae078-9161-4803-b3f5-2cbc478d197e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:22.901844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-596ae078-9161-4803-b3f5-2cbc478d197e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:22.907693 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-596ae078-9161-4803-b3f5-2cbc478d197e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:22.908173 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-596ae078-9161-4803-b3f5-2cbc478d197e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:22.908646 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-596ae078-9161-4803-b3f5-2cbc478d197e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:22.909343 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-596ae078-9161-4803-b3f5-2cbc478d197e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:22.909795 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-596ae078-9161-4803-b3f5-2cbc478d197e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:22.910220 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-596ae078-9161-4803-b3f5-2cbc478d197e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:22.934068 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-596ae078-9161-4803-b3f5-2cbc478d197e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:55:22.960051 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:23.273516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-596ae078-9161-4803-b3f5-2cbc478d197e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "DELETE /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 204 len: 0 microversion: 2.1 time: 0.376119 Aug 24 16:55:23.274023 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 324/645] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:55:22 2022] DELETE /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:23.282165 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9200cf61-b6e6-4697-9c09-38c34d913203 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:23.282749 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9200cf61-b6e6-4697-9c09-38c34d913203 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:23.289208 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9200cf61-b6e6-4697-9c09-38c34d913203 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:23.289692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9200cf61-b6e6-4697-9c09-38c34d913203 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:23.290145 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9200cf61-b6e6-4697-9c09-38c34d913203 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:23.290813 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9200cf61-b6e6-4697-9c09-38c34d913203 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:23.291273 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9200cf61-b6e6-4697-9c09-38c34d913203 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:23.291700 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9200cf61-b6e6-4697-9c09-38c34d913203 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:23.422230 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9200cf61-b6e6-4697-9c09-38c34d913203 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:23.430359 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9200cf61-b6e6-4697-9c09-38c34d913203 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1690 microversion: 2.1 time: 0.151640 Aug 24 16:55:23.431071 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 322/646] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:23 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:23.909277 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0b633264-ab0a-413d-9517-6c59be54b761 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:23.910464 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0b633264-ab0a-413d-9517-6c59be54b761 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:23.965878 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0b633264-ab0a-413d-9517-6c59be54b761 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:23.973181 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0b633264-ab0a-413d-9517-6c59be54b761 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:23.974680 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0b633264-ab0a-413d-9517-6c59be54b761 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:23.975777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0b633264-ab0a-413d-9517-6c59be54b761 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1282 microversion: 2.20 time: 0.070982 Aug 24 16:55:23.976339 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 325/647] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:23 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:24.450536 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d3162734-0a08-462c-bd79-32b0c39ff669 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:24.451145 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d3162734-0a08-462c-bd79-32b0c39ff669 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:24.457572 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d3162734-0a08-462c-bd79-32b0c39ff669 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:24.458046 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d3162734-0a08-462c-bd79-32b0c39ff669 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:24.458478 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d3162734-0a08-462c-bd79-32b0c39ff669 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:24.459156 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d3162734-0a08-462c-bd79-32b0c39ff669 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:24.459604 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d3162734-0a08-462c-bd79-32b0c39ff669 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:24.460023 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d3162734-0a08-462c-bd79-32b0c39ff669 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:24.586188 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d3162734-0a08-462c-bd79-32b0c39ff669 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:24.593899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d3162734-0a08-462c-bd79-32b0c39ff669 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1690 microversion: 2.1 time: 0.147181 Aug 24 16:55:24.594478 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 323/648] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:24 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:24.998898 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a216132f-dee4-4c2a-a8b5-8964499425f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:24.999546 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a216132f-dee4-4c2a-a8b5-8964499425f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:25.062608 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a216132f-dee4-4c2a-a8b5-8964499425f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:25.070439 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a216132f-dee4-4c2a-a8b5-8964499425f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:25.071948 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a216132f-dee4-4c2a-a8b5-8964499425f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:25.073110 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a216132f-dee4-4c2a-a8b5-8964499425f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1282 microversion: 2.20 time: 0.078031 Aug 24 16:55:25.073678 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 326/649] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:24 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1282 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:25.615093 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ab6bcfaf-8c5c-41eb-a3c3-c111c3479f1a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:25.615736 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ab6bcfaf-8c5c-41eb-a3c3-c111c3479f1a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:25.622154 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab6bcfaf-8c5c-41eb-a3c3-c111c3479f1a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:25.622638 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab6bcfaf-8c5c-41eb-a3c3-c111c3479f1a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:25.623079 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab6bcfaf-8c5c-41eb-a3c3-c111c3479f1a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:25.623771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab6bcfaf-8c5c-41eb-a3c3-c111c3479f1a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:25.624247 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab6bcfaf-8c5c-41eb-a3c3-c111c3479f1a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:25.624703 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab6bcfaf-8c5c-41eb-a3c3-c111c3479f1a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:25.750192 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ab6bcfaf-8c5c-41eb-a3c3-c111c3479f1a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:25.758755 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ab6bcfaf-8c5c-41eb-a3c3-c111c3479f1a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1690 microversion: 2.1 time: 0.147528 Aug 24 16:55:25.759328 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 324/650] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:25 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1690 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:26.095257 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2160e5e7-b7a6-436e-a961-73ef4481f5e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:26.095872 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2160e5e7-b7a6-436e-a961-73ef4481f5e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:26.149489 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2160e5e7-b7a6-436e-a961-73ef4481f5e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:26.156878 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2160e5e7-b7a6-436e-a961-73ef4481f5e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:26.158375 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2160e5e7-b7a6-436e-a961-73ef4481f5e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:26.159468 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2160e5e7-b7a6-436e-a961-73ef4481f5e5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1282 microversion: 2.20 time: 0.068070 Aug 24 16:55:26.160048 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 327/651] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:26 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1282 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:26.779702 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a1a85134-d3e0-4d71-8ef9-b74e12a66aee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:26.780337 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a1a85134-d3e0-4d71-8ef9-b74e12a66aee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:26.786697 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a1a85134-d3e0-4d71-8ef9-b74e12a66aee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:26.787173 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a1a85134-d3e0-4d71-8ef9-b74e12a66aee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:26.787605 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a1a85134-d3e0-4d71-8ef9-b74e12a66aee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:26.788290 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a1a85134-d3e0-4d71-8ef9-b74e12a66aee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:26.788806 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a1a85134-d3e0-4d71-8ef9-b74e12a66aee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:26.789730 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a1a85134-d3e0-4d71-8ef9-b74e12a66aee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:26.929133 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a1a85134-d3e0-4d71-8ef9-b74e12a66aee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:26.936760 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a1a85134-d3e0-4d71-8ef9-b74e12a66aee tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1690 microversion: 2.1 time: 0.160895 Aug 24 16:55:26.937329 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 325/652] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:26 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:27.182557 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f5792736-34df-4e6a-907d-f43f1e17bf83 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:27.183119 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f5792736-34df-4e6a-907d-f43f1e17bf83 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:27.189967 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5792736-34df-4e6a-907d-f43f1e17bf83 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:27.190446 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5792736-34df-4e6a-907d-f43f1e17bf83 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:27.190874 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5792736-34df-4e6a-907d-f43f1e17bf83 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:27.191565 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5792736-34df-4e6a-907d-f43f1e17bf83 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:27.192008 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5792736-34df-4e6a-907d-f43f1e17bf83 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:27.192441 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5792736-34df-4e6a-907d-f43f1e17bf83 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:27.256048 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f5792736-34df-4e6a-907d-f43f1e17bf83 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:27.265238 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f5792736-34df-4e6a-907d-f43f1e17bf83 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:27.266719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f5792736-34df-4e6a-907d-f43f1e17bf83 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:27.267820 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f5792736-34df-4e6a-907d-f43f1e17bf83 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1286 microversion: 2.20 time: 0.089791 Aug 24 16:55:27.268374 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 328/653] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:27 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:27.961701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-89dbf63a-40e5-4e81-a2b9-2845f0f0da18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:27.961701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-89dbf63a-40e5-4e81-a2b9-2845f0f0da18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:27.965931 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89dbf63a-40e5-4e81-a2b9-2845f0f0da18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:27.966612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89dbf63a-40e5-4e81-a2b9-2845f0f0da18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:27.967062 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89dbf63a-40e5-4e81-a2b9-2845f0f0da18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:27.967769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89dbf63a-40e5-4e81-a2b9-2845f0f0da18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:27.968257 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89dbf63a-40e5-4e81-a2b9-2845f0f0da18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:27.968732 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89dbf63a-40e5-4e81-a2b9-2845f0f0da18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:28.033067 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-89dbf63a-40e5-4e81-a2b9-2845f0f0da18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:28.041351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-89dbf63a-40e5-4e81-a2b9-2845f0f0da18 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1623 microversion: 2.1 time: 0.087443 Aug 24 16:55:28.041932 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 326/654] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:27 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1623 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:28.194153 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-920641e7-15d8-4de2-b14a-6d4320524d4f req-36c39361-b75c-412d-a8b6-efb089ba0275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ecc526-a083-4f47-ac70-0b06d5b66158", "name": "network-vif-deleted", "tag": "4cb866ee-2954-4fbb-953c-0cde1c4ca053"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:28.205360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-920641e7-15d8-4de2-b14a-6d4320524d4f req-36c39361-b75c-412d-a8b6-efb089ba0275 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:28.207046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-920641e7-15d8-4de2-b14a-6d4320524d4f req-36c39361-b75c-412d-a8b6-efb089ba0275 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:28.207046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-920641e7-15d8-4de2-b14a-6d4320524d4f req-36c39361-b75c-412d-a8b6-efb089ba0275 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:28.218351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-920641e7-15d8-4de2-b14a-6d4320524d4f req-36c39361-b75c-412d-a8b6-efb089ba0275 service nova] Creating event network-vif-deleted:4cb866ee-2954-4fbb-953c-0cde1c4ca053 for instance 84ecc526-a083-4f47-ac70-0b06d5b66158 on hv-cinder-85220 Aug 24 16:55:28.223667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-920641e7-15d8-4de2-b14a-6d4320524d4f req-36c39361-b75c-412d-a8b6-efb089ba0275 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033502 Aug 24 16:55:28.224259 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 329/655] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:28.290622 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d66f8ce2-d08d-4231-a24c-ecec1eadbcea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:28.291234 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d66f8ce2-d08d-4231-a24c-ecec1eadbcea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:28.300601 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d66f8ce2-d08d-4231-a24c-ecec1eadbcea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:28.301096 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d66f8ce2-d08d-4231-a24c-ecec1eadbcea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:28.301530 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d66f8ce2-d08d-4231-a24c-ecec1eadbcea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:28.302235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d66f8ce2-d08d-4231-a24c-ecec1eadbcea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:28.302689 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d66f8ce2-d08d-4231-a24c-ecec1eadbcea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:28.303296 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d66f8ce2-d08d-4231-a24c-ecec1eadbcea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:28.382160 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d66f8ce2-d08d-4231-a24c-ecec1eadbcea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:28.392111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d66f8ce2-d08d-4231-a24c-ecec1eadbcea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:28.393975 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d66f8ce2-d08d-4231-a24c-ecec1eadbcea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:28.395348 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d66f8ce2-d08d-4231-a24c-ecec1eadbcea tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1334 microversion: 2.20 time: 0.108804 Aug 24 16:55:28.396015 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 327/656] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:28 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1334 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:29.064046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:29.067302 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:29.072659 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:29.073311 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:29.073877 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:29.075334 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:29.075873 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:29.076369 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:29.114046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:29.114631 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:29.115136 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:29.115677 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lazy-loading 'fault' on Instance uuid 84ecc526-a083-4f47-ac70-0b06d5b66158 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:55:29.160249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:29.169121 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2a72a5a1-ce44-44d4-846c-24b594cfdde4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 200 len: 1335 microversion: 2.1 time: 0.110490 Aug 24 16:55:29.169701 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 330/657] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:29 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:29.419092 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ada05fc4-9716-4582-93e2-4ea70c67fa9e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:29.419700 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ada05fc4-9716-4582-93e2-4ea70c67fa9e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:29.426078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ada05fc4-9716-4582-93e2-4ea70c67fa9e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:29.426555 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ada05fc4-9716-4582-93e2-4ea70c67fa9e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:29.426986 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ada05fc4-9716-4582-93e2-4ea70c67fa9e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:29.427669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ada05fc4-9716-4582-93e2-4ea70c67fa9e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:29.428118 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ada05fc4-9716-4582-93e2-4ea70c67fa9e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:29.428585 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ada05fc4-9716-4582-93e2-4ea70c67fa9e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:29.501020 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ada05fc4-9716-4582-93e2-4ea70c67fa9e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:29.511625 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ada05fc4-9716-4582-93e2-4ea70c67fa9e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:29.513705 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ada05fc4-9716-4582-93e2-4ea70c67fa9e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:29.514817 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ada05fc4-9716-4582-93e2-4ea70c67fa9e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1340 microversion: 2.20 time: 0.099678 Aug 24 16:55:29.517462 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 328/658] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:29 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1340 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:29.636008 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4052319e-c548-4068-bf62-4ebcf3ef137f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:29.636606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4052319e-c548-4068-bf62-4ebcf3ef137f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:29.642953 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4052319e-c548-4068-bf62-4ebcf3ef137f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:29.643438 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4052319e-c548-4068-bf62-4ebcf3ef137f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:29.643872 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4052319e-c548-4068-bf62-4ebcf3ef137f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:29.644644 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4052319e-c548-4068-bf62-4ebcf3ef137f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:29.645056 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4052319e-c548-4068-bf62-4ebcf3ef137f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:29.645480 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4052319e-c548-4068-bf62-4ebcf3ef137f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:29.668595 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-4052319e-c548-4068-bf62-4ebcf3ef137f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lazy-loading 'flavor' on Instance uuid 62dfce7d-d2d5-4695-948f-8381f4ea6a91 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:55:29.906628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4052319e-c548-4068-bf62-4ebcf3ef137f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "POST /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91/action" status: 202 len: 0 microversion: 2.1 time: 0.274922 Aug 24 16:55:29.907424 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 331/659] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 16:55:29 2022] POST /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:55:29.916838 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-48bffcac-f5e1-48c5-bb00-745bd556c484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:29.917744 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-48bffcac-f5e1-48c5-bb00-745bd556c484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:29.923985 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-48bffcac-f5e1-48c5-bb00-745bd556c484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:29.924514 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-48bffcac-f5e1-48c5-bb00-745bd556c484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:29.925155 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-48bffcac-f5e1-48c5-bb00-745bd556c484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:29.926058 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-48bffcac-f5e1-48c5-bb00-745bd556c484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:29.926512 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-48bffcac-f5e1-48c5-bb00-745bd556c484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:29.927104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-48bffcac-f5e1-48c5-bb00-745bd556c484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:30.072732 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-48bffcac-f5e1-48c5-bb00-745bd556c484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:30.080791 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-48bffcac-f5e1-48c5-bb00-745bd556c484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.168617 Aug 24 16:55:30.081371 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 329/660] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:29 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:30.196127 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-637876bf-e1a1-466b-95ef-e8bf57594985 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:30.196781 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-637876bf-e1a1-466b-95ef-e8bf57594985 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 84ecc526-a083-4f47-ac70-0b06d5b66158] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:30.202997 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-637876bf-e1a1-466b-95ef-e8bf57594985 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:30.203474 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-637876bf-e1a1-466b-95ef-e8bf57594985 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:30.205395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-637876bf-e1a1-466b-95ef-e8bf57594985 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:30.205395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-637876bf-e1a1-466b-95ef-e8bf57594985 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:30.205395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-637876bf-e1a1-466b-95ef-e8bf57594985 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:30.205727 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-637876bf-e1a1-466b-95ef-e8bf57594985 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:30.219437 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-637876bf-e1a1-466b-95ef-e8bf57594985 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] HTTP exception thrown: Instance 84ecc526-a083-4f47-ac70-0b06d5b66158 could not be found. Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-637876bf-e1a1-466b-95ef-e8bf57594985 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Request method failure captured: Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 HTTP/1.1 Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZISQVjDYN-eIogkcFZs4LwnKoC8sLc9FZzdslGTzUrTNQWcUS4KZag3pL6aq7dRyIc2KFLdQFiK-4WL410C3YKTO4TmPCffofqSVR3WjOCdAkm3OD1T4kuqoqivwNCWFfuz5cdlLKVbaudAbBuC_4ZmqoIRB4h0CNWV89o1uMxmgw Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 42f5635b43e74a96a56d56cccbc111b5 Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:55:30.221162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:55:30.222748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:55:30.222748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:55:30.222748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 42f5635b43e74a96a56d56cccbc111b5 Aug 24 16:55:30.222748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:55:30.222748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-ServerRescueNegativeTestJSON-175432080-project Aug 24 16:55:30.222748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:55:30.222748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:55:30.222748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 45913fc3d9ba42ea9e971db25e656c61 Aug 24 16:55:30.222748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-175432080-project Aug 24 16:55:30.222748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:55:30.222748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 84ecc526-a083-4f47-ac70-0b06d5b66158 could not be found. Aug 24 16:55:30.222748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '84ecc526-a083-4f47-ac70-0b06d5b66158'} Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ecc526-a083-4f47-ac70-0b06d5b66158 could not be found. Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:30.223576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ecc526-a083-4f47-ac70-0b06d5b66158 could not be found. Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ecc526-a083-4f47-ac70-0b06d5b66158 could not be found. Aug 24 16:55:30.224803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:55:30.229955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-637876bf-e1a1-466b-95ef-e8bf57594985 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Returning 404 to user: Instance 84ecc526-a083-4f47-ac70-0b06d5b66158 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:30.229955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-637876bf-e1a1-466b-95ef-e8bf57594985 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158" status: 404 len: 111 microversion: 2.1 time: 0.031135 Aug 24 16:55:30.229955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 332/661] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:30 2022] GET /compute/v2.1/servers/84ecc526-a083-4f47-ac70-0b06d5b66158 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:55:30.231813 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-97df0a14-f178-48d3-847f-48512045505a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '.version_select at 0x7fa1949a8d30>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:30.303535 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-97df0a14-f178-48d3-847f-48512045505a tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486778919" status: 202 len: 0 microversion: 2.1 time: 0.076012 Aug 24 16:55:30.304131 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 330/662] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Aug 24 16:55:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486778919 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:55:30.545888 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-16666587-eaac-4a36-b3bc-3c9e4e125f6f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:30.546239 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-16666587-eaac-4a36-b3bc-3c9e4e125f6f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:30.555464 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16666587-eaac-4a36-b3bc-3c9e4e125f6f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:30.555957 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16666587-eaac-4a36-b3bc-3c9e4e125f6f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:30.556390 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16666587-eaac-4a36-b3bc-3c9e4e125f6f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:30.557118 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16666587-eaac-4a36-b3bc-3c9e4e125f6f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:30.557615 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16666587-eaac-4a36-b3bc-3c9e4e125f6f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:30.558037 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16666587-eaac-4a36-b3bc-3c9e4e125f6f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:30.761574 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-723a1f53-4248-4de1-aa81-b4f98442d353 req-4f6b1ef6-a1dd-43c5-95cb-92acefac37dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d1714b-1531-428f-a205-e42cedf76d9b", "tag": "629e65e7-9a31-4acf-8a66-2220e5591487"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:30.773062 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-723a1f53-4248-4de1-aa81-b4f98442d353 req-4f6b1ef6-a1dd-43c5-95cb-92acefac37dd service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:30.773832 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-723a1f53-4248-4de1-aa81-b4f98442d353 req-4f6b1ef6-a1dd-43c5-95cb-92acefac37dd service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:30.774390 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-723a1f53-4248-4de1-aa81-b4f98442d353 req-4f6b1ef6-a1dd-43c5-95cb-92acefac37dd service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:30.788452 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-723a1f53-4248-4de1-aa81-b4f98442d353 req-4f6b1ef6-a1dd-43c5-95cb-92acefac37dd service nova] Creating event network-changed:629e65e7-9a31-4acf-8a66-2220e5591487 for instance 09d1714b-1531-428f-a205-e42cedf76d9b on hv-cinder-85220 Aug 24 16:55:30.794107 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-723a1f53-4248-4de1-aa81-b4f98442d353 req-4f6b1ef6-a1dd-43c5-95cb-92acefac37dd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037444 Aug 24 16:55:30.794899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 331/663] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:30.801984 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-16666587-eaac-4a36-b3bc-3c9e4e125f6f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:30.811953 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-16666587-eaac-4a36-b3bc-3c9e4e125f6f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:30.813748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-16666587-eaac-4a36-b3bc-3c9e4e125f6f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:30.814869 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-16666587-eaac-4a36-b3bc-3c9e4e125f6f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1407 microversion: 2.20 time: 0.273367 Aug 24 16:55:30.815437 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 333/664] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:30 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:31.103707 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0c36318e-a320-44ad-bf15-d8249bfcd59f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:31.104427 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0c36318e-a320-44ad-bf15-d8249bfcd59f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:31.110826 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0c36318e-a320-44ad-bf15-d8249bfcd59f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:31.111318 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0c36318e-a320-44ad-bf15-d8249bfcd59f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:31.111765 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0c36318e-a320-44ad-bf15-d8249bfcd59f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:31.112524 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0c36318e-a320-44ad-bf15-d8249bfcd59f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:31.112982 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0c36318e-a320-44ad-bf15-d8249bfcd59f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:31.113540 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0c36318e-a320-44ad-bf15-d8249bfcd59f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:31.269579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0c36318e-a320-44ad-bf15-d8249bfcd59f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:31.278120 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0c36318e-a320-44ad-bf15-d8249bfcd59f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.179424 Aug 24 16:55:31.279019 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 332/665] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:31 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:31.838663 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a9540ff8-4758-4133-a3dc-5d2ce1ac56d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:31.839278 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a9540ff8-4758-4133-a3dc-5d2ce1ac56d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:31.845632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a9540ff8-4758-4133-a3dc-5d2ce1ac56d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:31.846114 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a9540ff8-4758-4133-a3dc-5d2ce1ac56d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:31.846548 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a9540ff8-4758-4133-a3dc-5d2ce1ac56d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:31.847230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a9540ff8-4758-4133-a3dc-5d2ce1ac56d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:31.847683 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a9540ff8-4758-4133-a3dc-5d2ce1ac56d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:31.848102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a9540ff8-4758-4133-a3dc-5d2ce1ac56d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:31.974435 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a9540ff8-4758-4133-a3dc-5d2ce1ac56d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:31.982456 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a9540ff8-4758-4133-a3dc-5d2ce1ac56d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:31.983923 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a9540ff8-4758-4133-a3dc-5d2ce1ac56d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:31.985037 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a9540ff8-4758-4133-a3dc-5d2ce1ac56d0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1407 microversion: 2.20 time: 0.150910 Aug 24 16:55:31.985611 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 334/666] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:31 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:32.299188 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-47694843-3d31-4cd1-a5b8-f9ceb292bb9c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:32.299836 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-47694843-3d31-4cd1-a5b8-f9ceb292bb9c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:32.306849 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-47694843-3d31-4cd1-a5b8-f9ceb292bb9c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:32.307336 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-47694843-3d31-4cd1-a5b8-f9ceb292bb9c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:32.307778 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-47694843-3d31-4cd1-a5b8-f9ceb292bb9c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:32.308503 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-47694843-3d31-4cd1-a5b8-f9ceb292bb9c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:32.308966 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-47694843-3d31-4cd1-a5b8-f9ceb292bb9c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:32.309391 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-47694843-3d31-4cd1-a5b8-f9ceb292bb9c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:32.313670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:32.458505 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-47694843-3d31-4cd1-a5b8-f9ceb292bb9c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:32.467517 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-47694843-3d31-4cd1-a5b8-f9ceb292bb9c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.172215 Aug 24 16:55:32.468085 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 333/667] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:32 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:33.008580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-581c1e2f-6de0-42be-9fee-2e5b920c931b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:33.009118 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-581c1e2f-6de0-42be-9fee-2e5b920c931b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:33.015536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-581c1e2f-6de0-42be-9fee-2e5b920c931b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:33.016016 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-581c1e2f-6de0-42be-9fee-2e5b920c931b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:33.016475 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-581c1e2f-6de0-42be-9fee-2e5b920c931b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:33.017252 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-581c1e2f-6de0-42be-9fee-2e5b920c931b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:33.017718 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-581c1e2f-6de0-42be-9fee-2e5b920c931b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:33.018139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-581c1e2f-6de0-42be-9fee-2e5b920c931b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:33.143934 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-581c1e2f-6de0-42be-9fee-2e5b920c931b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:33.152184 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-581c1e2f-6de0-42be-9fee-2e5b920c931b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:33.153738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-581c1e2f-6de0-42be-9fee-2e5b920c931b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:33.154862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-581c1e2f-6de0-42be-9fee-2e5b920c931b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1407 microversion: 2.20 time: 0.151197 Aug 24 16:55:33.155410 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 335/668] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:33 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:33.488111 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a12428da-1431-4b84-9d24-b7e155a78b20 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:33.488745 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a12428da-1431-4b84-9d24-b7e155a78b20 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:33.490842 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:33.491574 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=12 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:33.497584 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a12428da-1431-4b84-9d24-b7e155a78b20 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:33.507033 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a12428da-1431-4b84-9d24-b7e155a78b20 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:33.507033 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a12428da-1431-4b84-9d24-b7e155a78b20 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:33.507033 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a12428da-1431-4b84-9d24-b7e155a78b20 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:33.507033 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a12428da-1431-4b84-9d24-b7e155a78b20 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:33.507404 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a12428da-1431-4b84-9d24-b7e155a78b20 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:33.633009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a12428da-1431-4b84-9d24-b7e155a78b20 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:33.640578 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a12428da-1431-4b84-9d24-b7e155a78b20 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.156233 Aug 24 16:55:33.641143 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 334/669] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:33 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:33.812824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d937f8ce-e2cd-422c-9326-982c6befbf76 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:33.813320 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d937f8ce-e2cd-422c-9326-982c6befbf76 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:33.819095 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d937f8ce-e2cd-422c-9326-982c6befbf76 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:33.823854 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d937f8ce-e2cd-422c-9326-982c6befbf76 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:33.823854 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d937f8ce-e2cd-422c-9326-982c6befbf76 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:33.823854 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d937f8ce-e2cd-422c-9326-982c6befbf76 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:33.823854 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d937f8ce-e2cd-422c-9326-982c6befbf76 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:33.824274 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d937f8ce-e2cd-422c-9326-982c6befbf76 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:33.847741 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d937f8ce-e2cd-422c-9326-982c6befbf76 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:55:34.177332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2cd6a2b7-f0ca-4e11-a890-5bbd136514bb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:34.177987 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2cd6a2b7-f0ca-4e11-a890-5bbd136514bb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:34.183918 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2cd6a2b7-f0ca-4e11-a890-5bbd136514bb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:34.190237 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2cd6a2b7-f0ca-4e11-a890-5bbd136514bb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:34.190237 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2cd6a2b7-f0ca-4e11-a890-5bbd136514bb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:34.190237 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2cd6a2b7-f0ca-4e11-a890-5bbd136514bb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:34.190237 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2cd6a2b7-f0ca-4e11-a890-5bbd136514bb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:34.190638 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2cd6a2b7-f0ca-4e11-a890-5bbd136514bb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:34.212066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d937f8ce-e2cd-422c-9326-982c6befbf76 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 204 len: 0 microversion: 2.1 time: 0.401975 Aug 24 16:55:34.212869 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 336/670] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:55:33 2022] DELETE /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:34.225876 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5112cd39-0c39-4e30-8add-a4687d95045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:34.229309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5112cd39-0c39-4e30-8add-a4687d95045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:34.236678 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5112cd39-0c39-4e30-8add-a4687d95045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:34.237175 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5112cd39-0c39-4e30-8add-a4687d95045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:34.237603 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5112cd39-0c39-4e30-8add-a4687d95045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:34.238297 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5112cd39-0c39-4e30-8add-a4687d95045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:34.238740 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5112cd39-0c39-4e30-8add-a4687d95045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:34.239154 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5112cd39-0c39-4e30-8add-a4687d95045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:34.374758 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2cd6a2b7-f0ca-4e11-a890-5bbd136514bb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:34.383659 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2cd6a2b7-f0ca-4e11-a890-5bbd136514bb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:34.385479 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2cd6a2b7-f0ca-4e11-a890-5bbd136514bb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:34.386591 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2cd6a2b7-f0ca-4e11-a890-5bbd136514bb tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1407 microversion: 2.20 time: 0.213183 Aug 24 16:55:34.387156 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 335/671] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:34 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:55:34.405385 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5112cd39-0c39-4e30-8add-a4687d95045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:34.412978 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5112cd39-0c39-4e30-8add-a4687d95045b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1508 microversion: 2.1 time: 0.195067 Aug 24 16:55:34.421280 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 337/672] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:34 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:34.661039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-bc2aa408-c46a-47bb-becf-82dde6393ad6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:34.661653 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-bc2aa408-c46a-47bb-becf-82dde6393ad6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:34.668300 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bc2aa408-c46a-47bb-becf-82dde6393ad6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:34.668859 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bc2aa408-c46a-47bb-becf-82dde6393ad6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:34.669297 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bc2aa408-c46a-47bb-becf-82dde6393ad6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:34.669990 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bc2aa408-c46a-47bb-becf-82dde6393ad6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:34.670442 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bc2aa408-c46a-47bb-becf-82dde6393ad6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:34.670860 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-bc2aa408-c46a-47bb-becf-82dde6393ad6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:34.799409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-bc2aa408-c46a-47bb-becf-82dde6393ad6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:34.807805 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-bc2aa408-c46a-47bb-becf-82dde6393ad6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.150539 Aug 24 16:55:34.808423 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 336/673] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:34 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:35.409455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3696b41c-e092-42dc-9220-84d29ad2994a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:35.410164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3696b41c-e092-42dc-9220-84d29ad2994a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:35.416842 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3696b41c-e092-42dc-9220-84d29ad2994a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:35.422078 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3696b41c-e092-42dc-9220-84d29ad2994a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:35.422078 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3696b41c-e092-42dc-9220-84d29ad2994a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:35.422078 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3696b41c-e092-42dc-9220-84d29ad2994a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:35.422078 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3696b41c-e092-42dc-9220-84d29ad2994a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:35.422781 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3696b41c-e092-42dc-9220-84d29ad2994a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:35.440433 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f6282f5a-5c8c-4339-aeb1-515f457e245b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:35.441147 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f6282f5a-5c8c-4339-aeb1-515f457e245b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:35.447943 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f6282f5a-5c8c-4339-aeb1-515f457e245b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:35.448441 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f6282f5a-5c8c-4339-aeb1-515f457e245b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:35.448879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f6282f5a-5c8c-4339-aeb1-515f457e245b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:35.449564 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f6282f5a-5c8c-4339-aeb1-515f457e245b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:35.450016 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f6282f5a-5c8c-4339-aeb1-515f457e245b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:35.450436 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f6282f5a-5c8c-4339-aeb1-515f457e245b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:35.533693 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f6282f5a-5c8c-4339-aeb1-515f457e245b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:35.542403 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f6282f5a-5c8c-4339-aeb1-515f457e245b tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 200 len: 1466 microversion: 2.1 time: 0.105644 Aug 24 16:55:35.549049 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 337/674] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:35 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 1466 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:35.577032 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-fd0e8408-e7d9-413d-a88e-869ba6587d47 req-d901aa0b-b4e6-4637-806b-8e0dcfa61f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5377571a-2ee1-4cb8-b47e-cd4f48808e8b", "name": "network-vif-deleted", "tag": "5892788f-be73-4ceb-af43-492175260ae5"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:35.586043 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3696b41c-e092-42dc-9220-84d29ad2994a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:35.593835 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-fd0e8408-e7d9-413d-a88e-869ba6587d47 req-d901aa0b-b4e6-4637-806b-8e0dcfa61f4d service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:35.596273 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3696b41c-e092-42dc-9220-84d29ad2994a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:35.596912 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-fd0e8408-e7d9-413d-a88e-869ba6587d47 req-d901aa0b-b4e6-4637-806b-8e0dcfa61f4d service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:35.596912 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-fd0e8408-e7d9-413d-a88e-869ba6587d47 req-d901aa0b-b4e6-4637-806b-8e0dcfa61f4d service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:35.597123 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3696b41c-e092-42dc-9220-84d29ad2994a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:35.597123 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3696b41c-e092-42dc-9220-84d29ad2994a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1407 microversion: 2.20 time: 0.191448 Aug 24 16:55:35.608032 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-fd0e8408-e7d9-413d-a88e-869ba6587d47 req-d901aa0b-b4e6-4637-806b-8e0dcfa61f4d service nova] Creating event network-vif-deleted:5892788f-be73-4ceb-af43-492175260ae5 for instance 5377571a-2ee1-4cb8-b47e-cd4f48808e8b on hv-cinder-85220 Aug 24 16:55:35.612506 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 338/675] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:35 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:35.613214 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-fd0e8408-e7d9-413d-a88e-869ba6587d47 req-d901aa0b-b4e6-4637-806b-8e0dcfa61f4d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040883 Aug 24 16:55:35.614081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 338/676] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:35.828575 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-12445743-e1b5-47ec-88b6-ac03f5cbff04 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:35.829454 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-12445743-e1b5-47ec-88b6-ac03f5cbff04 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:35.835461 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12445743-e1b5-47ec-88b6-ac03f5cbff04 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:35.835949 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12445743-e1b5-47ec-88b6-ac03f5cbff04 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:35.836386 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12445743-e1b5-47ec-88b6-ac03f5cbff04 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:35.837136 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12445743-e1b5-47ec-88b6-ac03f5cbff04 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:35.837602 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12445743-e1b5-47ec-88b6-ac03f5cbff04 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:35.838012 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12445743-e1b5-47ec-88b6-ac03f5cbff04 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:35.977142 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-12445743-e1b5-47ec-88b6-ac03f5cbff04 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:35.985117 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-12445743-e1b5-47ec-88b6-ac03f5cbff04 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.160552 Aug 24 16:55:35.985694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 339/677] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:35 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:36.564886 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a898835c-7e9c-4b04-a701-9f1e62889f71 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:36.565594 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a898835c-7e9c-4b04-a701-9f1e62889f71 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: 5377571a-2ee1-4cb8-b47e-cd4f48808e8b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:36.575636 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a898835c-7e9c-4b04-a701-9f1e62889f71 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:36.576492 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a898835c-7e9c-4b04-a701-9f1e62889f71 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:36.576666 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a898835c-7e9c-4b04-a701-9f1e62889f71 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:36.578000 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a898835c-7e9c-4b04-a701-9f1e62889f71 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:36.578532 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a898835c-7e9c-4b04-a701-9f1e62889f71 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:36.578973 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a898835c-7e9c-4b04-a701-9f1e62889f71 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:36.593363 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-a898835c-7e9c-4b04-a701-9f1e62889f71 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] HTTP exception thrown: Instance 5377571a-2ee1-4cb8-b47e-cd4f48808e8b could not be found. Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a898835c-7e9c-4b04-a701-9f1e62889f71 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Request method failure captured: Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b HTTP/1.1 Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZISQVjDYN-eIogkcFZs4LwnKoC8sLc9FZzdslGTzUrTNQWcUS4KZag3pL6aq7dRyIc2KFLdQFiK-4WL410C3YKTO4TmPCffofqSVR3WjOCdAkm3OD1T4kuqoqivwNCWFfuz5cdlLKVbaudAbBuC_4ZmqoIRB4h0CNWV89o1uMxmgw Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 42f5635b43e74a96a56d56cccbc111b5 Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:55:36.595025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:55:36.596458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:55:36.596458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:55:36.596458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 42f5635b43e74a96a56d56cccbc111b5 Aug 24 16:55:36.596458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:55:36.596458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-ServerRescueNegativeTestJSON-175432080-project Aug 24 16:55:36.596458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:55:36.596458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:55:36.596458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 45913fc3d9ba42ea9e971db25e656c61 Aug 24 16:55:36.596458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-175432080-project Aug 24 16:55:36.596458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:55:36.596458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 5377571a-2ee1-4cb8-b47e-cd4f48808e8b could not be found. Aug 24 16:55:36.596458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '5377571a-2ee1-4cb8-b47e-cd4f48808e8b'} Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5377571a-2ee1-4cb8-b47e-cd4f48808e8b could not be found. Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:36.606104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5377571a-2ee1-4cb8-b47e-cd4f48808e8b could not be found. Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5377571a-2ee1-4cb8-b47e-cd4f48808e8b could not be found. Aug 24 16:55:36.607596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:55:36.609047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a898835c-7e9c-4b04-a701-9f1e62889f71 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Returning 404 to user: Instance 5377571a-2ee1-4cb8-b47e-cd4f48808e8b could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:36.609047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a898835c-7e9c-4b04-a701-9f1e62889f71 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b" status: 404 len: 111 microversion: 2.1 time: 0.035887 Aug 24 16:55:36.609047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 339/678] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:36 2022] GET /compute/v2.1/servers/5377571a-2ee1-4cb8-b47e-cd4f48808e8b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:55:36.609351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e389680d-a533-4b18-a06c-9a99606cbf7e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:36.609351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e389680d-a533-4b18-a06c-9a99606cbf7e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:36.609351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=6 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:36.612717 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e389680d-a533-4b18-a06c-9a99606cbf7e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:36.613195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e389680d-a533-4b18-a06c-9a99606cbf7e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:36.613633 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e389680d-a533-4b18-a06c-9a99606cbf7e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:36.614326 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e389680d-a533-4b18-a06c-9a99606cbf7e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:36.614779 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e389680d-a533-4b18-a06c-9a99606cbf7e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:36.615205 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e389680d-a533-4b18-a06c-9a99606cbf7e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:36.619819 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-be30dcd7-b0c4-4ef1-84f8-075c82e0108b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:36.620456 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-be30dcd7-b0c4-4ef1-84f8-075c82e0108b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:36.626858 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be30dcd7-b0c4-4ef1-84f8-075c82e0108b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:36.627342 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be30dcd7-b0c4-4ef1-84f8-075c82e0108b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:36.627777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be30dcd7-b0c4-4ef1-84f8-075c82e0108b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:36.628746 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be30dcd7-b0c4-4ef1-84f8-075c82e0108b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:36.629206 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be30dcd7-b0c4-4ef1-84f8-075c82e0108b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:36.629629 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be30dcd7-b0c4-4ef1-84f8-075c82e0108b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:36.641265 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e389680d-a533-4b18-a06c-9a99606cbf7e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:55:36.644008 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:36.758381 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-be30dcd7-b0c4-4ef1-84f8-075c82e0108b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:36.766655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-be30dcd7-b0c4-4ef1-84f8-075c82e0108b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:36.768338 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-be30dcd7-b0c4-4ef1-84f8-075c82e0108b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:36.769474 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-be30dcd7-b0c4-4ef1-84f8-075c82e0108b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1407 microversion: 2.20 time: 0.154226 Aug 24 16:55:36.770226 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 340/679] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:36 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:55:36.924868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e389680d-a533-4b18-a06c-9a99606cbf7e tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 204 len: 0 microversion: 2.1 time: 0.323351 Aug 24 16:55:36.925447 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 340/680] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:55:36 2022] DELETE /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:55:36.933437 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-06b1eee4-35da-418e-9352-f57189d35374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:36.934316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-06b1eee4-35da-418e-9352-f57189d35374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:36.940272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-06b1eee4-35da-418e-9352-f57189d35374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:36.940799 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-06b1eee4-35da-418e-9352-f57189d35374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:36.941244 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-06b1eee4-35da-418e-9352-f57189d35374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:36.941936 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-06b1eee4-35da-418e-9352-f57189d35374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:36.942395 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-06b1eee4-35da-418e-9352-f57189d35374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:36.942827 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-06b1eee4-35da-418e-9352-f57189d35374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:37.007936 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-715806e8-1466-4588-8a10-7df04cc3b0f7 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:37.008676 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-715806e8-1466-4588-8a10-7df04cc3b0f7 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:37.015099 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-715806e8-1466-4588-8a10-7df04cc3b0f7 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:37.015586 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-715806e8-1466-4588-8a10-7df04cc3b0f7 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:37.016027 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-715806e8-1466-4588-8a10-7df04cc3b0f7 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:37.016782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-715806e8-1466-4588-8a10-7df04cc3b0f7 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:37.017249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-715806e8-1466-4588-8a10-7df04cc3b0f7 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:37.017685 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-715806e8-1466-4588-8a10-7df04cc3b0f7 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:37.109175 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-06b1eee4-35da-418e-9352-f57189d35374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:37.117775 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-06b1eee4-35da-418e-9352-f57189d35374 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.187520 Aug 24 16:55:37.118706 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 341/681] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:36 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:37.172904 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-715806e8-1466-4588-8a10-7df04cc3b0f7 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:37.181759 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-715806e8-1466-4588-8a10-7df04cc3b0f7 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.179210 Aug 24 16:55:37.182394 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 341/682] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:37 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:37.279048 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-131fe166-af0c-4a0c-ad05-aa9899f736d9 req-46184c92-75bf-412a-9757-8debc36feb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d1714b-1531-428f-a205-e42cedf76d9b", "name": "network-vif-plugged", "status": "completed", "tag": "629e65e7-9a31-4acf-8a66-2220e5591487"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:37.288366 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-131fe166-af0c-4a0c-ad05-aa9899f736d9 req-46184c92-75bf-412a-9757-8debc36feb43 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:37.289388 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-131fe166-af0c-4a0c-ad05-aa9899f736d9 req-46184c92-75bf-412a-9757-8debc36feb43 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:37.289822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-131fe166-af0c-4a0c-ad05-aa9899f736d9 req-46184c92-75bf-412a-9757-8debc36feb43 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:37.300643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-131fe166-af0c-4a0c-ad05-aa9899f736d9 req-46184c92-75bf-412a-9757-8debc36feb43 service nova] Creating event network-vif-plugged:629e65e7-9a31-4acf-8a66-2220e5591487 for instance 09d1714b-1531-428f-a205-e42cedf76d9b on hv-cinder-85220 Aug 24 16:55:37.306052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-131fe166-af0c-4a0c-ad05-aa9899f736d9 req-46184c92-75bf-412a-9757-8debc36feb43 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030728 Aug 24 16:55:37.306624 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 342/683] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:37.793157 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7f2650fa-65c5-43c2-b92b-9ccdb699adee tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:37.793677 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7f2650fa-65c5-43c2-b92b-9ccdb699adee tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:37.800358 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f2650fa-65c5-43c2-b92b-9ccdb699adee tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:37.800870 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f2650fa-65c5-43c2-b92b-9ccdb699adee tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:37.801303 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f2650fa-65c5-43c2-b92b-9ccdb699adee tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:37.801985 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f2650fa-65c5-43c2-b92b-9ccdb699adee tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:37.802438 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f2650fa-65c5-43c2-b92b-9ccdb699adee tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:37.802858 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f2650fa-65c5-43c2-b92b-9ccdb699adee tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:37.933736 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7f2650fa-65c5-43c2-b92b-9ccdb699adee tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:37.941933 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7f2650fa-65c5-43c2-b92b-9ccdb699adee tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:37.945651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7f2650fa-65c5-43c2-b92b-9ccdb699adee tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:37.945651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7f2650fa-65c5-43c2-b92b-9ccdb699adee tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1407 microversion: 2.20 time: 0.155912 Aug 24 16:55:37.945651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 342/684] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:37 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:38.139909 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4ee46e30-2590-403d-b6a1-6b35fe7ab52c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:38.140639 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4ee46e30-2590-403d-b6a1-6b35fe7ab52c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:38.146636 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ee46e30-2590-403d-b6a1-6b35fe7ab52c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:38.147118 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ee46e30-2590-403d-b6a1-6b35fe7ab52c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:38.147549 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ee46e30-2590-403d-b6a1-6b35fe7ab52c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:38.148741 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ee46e30-2590-403d-b6a1-6b35fe7ab52c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:38.149201 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ee46e30-2590-403d-b6a1-6b35fe7ab52c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:38.149620 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4ee46e30-2590-403d-b6a1-6b35fe7ab52c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:38.202218 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3cf9bf54-2f4d-4cf8-b03e-9e462c8122cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:38.202935 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3cf9bf54-2f4d-4cf8-b03e-9e462c8122cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:38.209095 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3cf9bf54-2f4d-4cf8-b03e-9e462c8122cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:38.209673 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3cf9bf54-2f4d-4cf8-b03e-9e462c8122cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:38.210181 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3cf9bf54-2f4d-4cf8-b03e-9e462c8122cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:38.210976 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3cf9bf54-2f4d-4cf8-b03e-9e462c8122cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:38.211502 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3cf9bf54-2f4d-4cf8-b03e-9e462c8122cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:38.211996 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3cf9bf54-2f4d-4cf8-b03e-9e462c8122cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:38.316344 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4ee46e30-2590-403d-b6a1-6b35fe7ab52c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:38.324718 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4ee46e30-2590-403d-b6a1-6b35fe7ab52c tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.189372 Aug 24 16:55:38.325285 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 343/685] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:38 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:38.364422 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3cf9bf54-2f4d-4cf8-b03e-9e462c8122cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:38.372595 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3cf9bf54-2f4d-4cf8-b03e-9e462c8122cd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.174174 Aug 24 16:55:38.373165 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 343/686] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:38 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:38.967701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2387c58d-6f76-4805-8f3f-38239ab24874 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:38.968311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2387c58d-6f76-4805-8f3f-38239ab24874 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:38.974210 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2387c58d-6f76-4805-8f3f-38239ab24874 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:38.974700 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2387c58d-6f76-4805-8f3f-38239ab24874 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:38.975135 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2387c58d-6f76-4805-8f3f-38239ab24874 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:38.975820 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2387c58d-6f76-4805-8f3f-38239ab24874 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:38.977090 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2387c58d-6f76-4805-8f3f-38239ab24874 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:38.977573 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2387c58d-6f76-4805-8f3f-38239ab24874 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:39.109074 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2387c58d-6f76-4805-8f3f-38239ab24874 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:39.113247 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2387c58d-6f76-4805-8f3f-38239ab24874 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:39.114688 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2387c58d-6f76-4805-8f3f-38239ab24874 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:39.115793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2387c58d-6f76-4805-8f3f-38239ab24874 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1407 microversion: 2.20 time: 0.151977 Aug 24 16:55:39.116346 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 344/687] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:38 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:39.345445 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0b4bfc82-76a6-4970-8514-2d121f9bfae4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:39.346062 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0b4bfc82-76a6-4970-8514-2d121f9bfae4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:39.352358 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b4bfc82-76a6-4970-8514-2d121f9bfae4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:39.352867 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b4bfc82-76a6-4970-8514-2d121f9bfae4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:39.353299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b4bfc82-76a6-4970-8514-2d121f9bfae4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:39.353980 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b4bfc82-76a6-4970-8514-2d121f9bfae4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:39.354445 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b4bfc82-76a6-4970-8514-2d121f9bfae4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:39.354880 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b4bfc82-76a6-4970-8514-2d121f9bfae4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:39.393788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b4f6d3fa-217d-4172-abc7-0014c5200875 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:39.394323 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b4f6d3fa-217d-4172-abc7-0014c5200875 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:39.401405 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b4f6d3fa-217d-4172-abc7-0014c5200875 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:39.401910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b4f6d3fa-217d-4172-abc7-0014c5200875 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:39.402398 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b4f6d3fa-217d-4172-abc7-0014c5200875 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:39.403126 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b4f6d3fa-217d-4172-abc7-0014c5200875 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:39.403617 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b4f6d3fa-217d-4172-abc7-0014c5200875 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:39.404041 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b4f6d3fa-217d-4172-abc7-0014c5200875 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:39.543343 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0b4bfc82-76a6-4970-8514-2d121f9bfae4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:39.551297 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0b4bfc82-76a6-4970-8514-2d121f9bfae4 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.209660 Aug 24 16:55:39.551857 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 344/688] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:39 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:39.572008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b4f6d3fa-217d-4172-abc7-0014c5200875 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:39.580164 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b4f6d3fa-217d-4172-abc7-0014c5200875 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.190227 Aug 24 16:55:39.580770 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 345/689] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:39 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:40.138627 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1bc60cd3-9ef7-4cf4-933d-2e442a758c58 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:40.139278 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1bc60cd3-9ef7-4cf4-933d-2e442a758c58 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:40.145487 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1bc60cd3-9ef7-4cf4-933d-2e442a758c58 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:40.145996 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1bc60cd3-9ef7-4cf4-933d-2e442a758c58 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:40.146428 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1bc60cd3-9ef7-4cf4-933d-2e442a758c58 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:40.147112 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1bc60cd3-9ef7-4cf4-933d-2e442a758c58 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:40.147563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1bc60cd3-9ef7-4cf4-933d-2e442a758c58 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:40.147980 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1bc60cd3-9ef7-4cf4-933d-2e442a758c58 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:40.272735 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1bc60cd3-9ef7-4cf4-933d-2e442a758c58 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:40.280790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1bc60cd3-9ef7-4cf4-933d-2e442a758c58 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:40.282277 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1bc60cd3-9ef7-4cf4-933d-2e442a758c58 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:40.283371 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1bc60cd3-9ef7-4cf4-933d-2e442a758c58 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1407 microversion: 2.20 time: 0.148770 Aug 24 16:55:40.283927 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 345/690] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:40 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:40.572447 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1a8c8b2d-a499-48ac-9df9-7282ce952715 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:40.573066 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1a8c8b2d-a499-48ac-9df9-7282ce952715 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:40.579715 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a8c8b2d-a499-48ac-9df9-7282ce952715 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:40.580208 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a8c8b2d-a499-48ac-9df9-7282ce952715 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:40.580679 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a8c8b2d-a499-48ac-9df9-7282ce952715 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:40.581436 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a8c8b2d-a499-48ac-9df9-7282ce952715 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:40.581898 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a8c8b2d-a499-48ac-9df9-7282ce952715 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:40.582327 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a8c8b2d-a499-48ac-9df9-7282ce952715 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:40.607221 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-25377f80-ac5a-43f3-a0e3-9df5002b32fa tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:40.607845 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-25377f80-ac5a-43f3-a0e3-9df5002b32fa tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:40.614413 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25377f80-ac5a-43f3-a0e3-9df5002b32fa tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:40.614903 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25377f80-ac5a-43f3-a0e3-9df5002b32fa tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:40.615339 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25377f80-ac5a-43f3-a0e3-9df5002b32fa tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:40.621677 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25377f80-ac5a-43f3-a0e3-9df5002b32fa tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:40.622148 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25377f80-ac5a-43f3-a0e3-9df5002b32fa tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:40.622574 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25377f80-ac5a-43f3-a0e3-9df5002b32fa tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:40.771293 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1a8c8b2d-a499-48ac-9df9-7282ce952715 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:40.779676 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1a8c8b2d-a499-48ac-9df9-7282ce952715 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1520 microversion: 2.1 time: 0.211087 Aug 24 16:55:40.780266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 346/691] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:40 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:40.801116 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-25377f80-ac5a-43f3-a0e3-9df5002b32fa tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:40.808899 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-25377f80-ac5a-43f3-a0e3-9df5002b32fa tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.205588 Aug 24 16:55:40.809467 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 346/692] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:40 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:41.306947 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-cf8b774d-2ef3-48f8-90a1-f0fa289ff584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:41.307556 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-cf8b774d-2ef3-48f8-90a1-f0fa289ff584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:41.309670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:41.314348 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cf8b774d-2ef3-48f8-90a1-f0fa289ff584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:41.314856 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cf8b774d-2ef3-48f8-90a1-f0fa289ff584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:41.315372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cf8b774d-2ef3-48f8-90a1-f0fa289ff584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:41.316038 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cf8b774d-2ef3-48f8-90a1-f0fa289ff584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:41.316526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cf8b774d-2ef3-48f8-90a1-f0fa289ff584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:41.317014 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cf8b774d-2ef3-48f8-90a1-f0fa289ff584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:41.451712 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cf8b774d-2ef3-48f8-90a1-f0fa289ff584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:41.459984 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cf8b774d-2ef3-48f8-90a1-f0fa289ff584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:41.461525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cf8b774d-2ef3-48f8-90a1-f0fa289ff584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:41.462622 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-cf8b774d-2ef3-48f8-90a1-f0fa289ff584 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1407 microversion: 2.20 time: 0.160297 Aug 24 16:55:41.463187 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 347/693] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:41 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:55:41.621525 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-602e95ea-a55d-4467-aa93-fe4d97295821 req-1ea59fa1-cf74-4002-a0a4-4af815cbe677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b", "name": "network-vif-deleted", "tag": "eebf25cb-9859-40a8-8cd8-a778ec3005bd"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:41.633845 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-602e95ea-a55d-4467-aa93-fe4d97295821 req-1ea59fa1-cf74-4002-a0a4-4af815cbe677 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:41.634318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-602e95ea-a55d-4467-aa93-fe4d97295821 req-1ea59fa1-cf74-4002-a0a4-4af815cbe677 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:41.634746 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-602e95ea-a55d-4467-aa93-fe4d97295821 req-1ea59fa1-cf74-4002-a0a4-4af815cbe677 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:41.646828 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-602e95ea-a55d-4467-aa93-fe4d97295821 req-1ea59fa1-cf74-4002-a0a4-4af815cbe677 service nova] Creating event network-vif-deleted:eebf25cb-9859-40a8-8cd8-a778ec3005bd for instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b on hv-cinder-85220 Aug 24 16:55:41.652068 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-602e95ea-a55d-4467-aa93-fe4d97295821 req-1ea59fa1-cf74-4002-a0a4-4af815cbe677 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035693 Aug 24 16:55:41.652658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 347/694] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:41.801379 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6063b5ae-b1cb-45af-a7e0-fd916a5843c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:41.801993 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6063b5ae-b1cb-45af-a7e0-fd916a5843c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:41.809077 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6063b5ae-b1cb-45af-a7e0-fd916a5843c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:41.809558 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6063b5ae-b1cb-45af-a7e0-fd916a5843c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:41.809994 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6063b5ae-b1cb-45af-a7e0-fd916a5843c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:41.810716 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6063b5ae-b1cb-45af-a7e0-fd916a5843c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:41.811170 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6063b5ae-b1cb-45af-a7e0-fd916a5843c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:41.811598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6063b5ae-b1cb-45af-a7e0-fd916a5843c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:41.830148 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-27a42f5b-ba22-4fec-bc52-3dcd681ec1df tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:41.830801 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-27a42f5b-ba22-4fec-bc52-3dcd681ec1df tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:41.836891 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27a42f5b-ba22-4fec-bc52-3dcd681ec1df tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:41.837400 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27a42f5b-ba22-4fec-bc52-3dcd681ec1df tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:41.837829 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27a42f5b-ba22-4fec-bc52-3dcd681ec1df tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:41.838520 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27a42f5b-ba22-4fec-bc52-3dcd681ec1df tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:41.838967 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27a42f5b-ba22-4fec-bc52-3dcd681ec1df tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:41.839383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27a42f5b-ba22-4fec-bc52-3dcd681ec1df tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:41.879631 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6063b5ae-b1cb-45af-a7e0-fd916a5843c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:41.887751 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6063b5ae-b1cb-45af-a7e0-fd916a5843c5 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1478 microversion: 2.1 time: 0.090505 Aug 24 16:55:41.888545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 348/695] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:41 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1478 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:41.987704 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-27a42f5b-ba22-4fec-bc52-3dcd681ec1df tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:41.996094 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-27a42f5b-ba22-4fec-bc52-3dcd681ec1df tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.170314 Aug 24 16:55:41.996754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 348/696] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:41 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:42.484873 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a61bf139-1ba7-4484-b857-6be64e9b2f88 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:42.485489 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a61bf139-1ba7-4484-b857-6be64e9b2f88 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:42.491324 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a61bf139-1ba7-4484-b857-6be64e9b2f88 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:42.491808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a61bf139-1ba7-4484-b857-6be64e9b2f88 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:42.492245 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a61bf139-1ba7-4484-b857-6be64e9b2f88 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:42.492961 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a61bf139-1ba7-4484-b857-6be64e9b2f88 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:42.493413 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a61bf139-1ba7-4484-b857-6be64e9b2f88 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:42.493837 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a61bf139-1ba7-4484-b857-6be64e9b2f88 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:42.623436 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a61bf139-1ba7-4484-b857-6be64e9b2f88 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:42.632205 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a61bf139-1ba7-4484-b857-6be64e9b2f88 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:42.634299 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a61bf139-1ba7-4484-b857-6be64e9b2f88 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:42.635493 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a61bf139-1ba7-4484-b857-6be64e9b2f88 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1599 microversion: 2.20 time: 0.154499 Aug 24 16:55:42.636172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 349/697] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:55:42 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:55:42.657803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9d21b656-b703-4208-b50e-5b668d3da0a8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:42.658307 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9d21b656-b703-4208-b50e-5b668d3da0a8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:42.664646 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d21b656-b703-4208-b50e-5b668d3da0a8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:42.665133 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d21b656-b703-4208-b50e-5b668d3da0a8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:42.665571 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d21b656-b703-4208-b50e-5b668d3da0a8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:42.666263 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d21b656-b703-4208-b50e-5b668d3da0a8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:42.666716 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d21b656-b703-4208-b50e-5b668d3da0a8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:42.667140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d21b656-b703-4208-b50e-5b668d3da0a8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:42.742373 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9d21b656-b703-4208-b50e-5b668d3da0a8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087785 Aug 24 16:55:42.742971 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 349/698] 10.222.0.70 () {60 vars in 1316 bytes} [Wed Aug 24 16:55:42 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:55:42.913125 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:42.913971 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:42.920222 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:42.920744 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:42.921176 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:42.921859 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:42.922310 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:42.922730 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:42.953759 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:42.954239 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:42.954672 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:42.955108 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lazy-loading 'fault' on Instance uuid dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:55:43.001145 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:43.010390 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fd46fd80-6fbd-478f-b887-fb3921ccc894 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1310 microversion: 2.1 time: 0.101056 Aug 24 16:55:43.012307 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 350/699] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:42 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1310 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:43.018499 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-71b73cd3-2631-4173-90e3-15335cbd5a57 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:43.019346 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-71b73cd3-2631-4173-90e3-15335cbd5a57 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:43.025879 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71b73cd3-2631-4173-90e3-15335cbd5a57 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:43.026442 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71b73cd3-2631-4173-90e3-15335cbd5a57 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:43.026883 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71b73cd3-2631-4173-90e3-15335cbd5a57 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:43.027611 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71b73cd3-2631-4173-90e3-15335cbd5a57 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:43.028070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71b73cd3-2631-4173-90e3-15335cbd5a57 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:43.028529 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71b73cd3-2631-4173-90e3-15335cbd5a57 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:43.518240 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-71b73cd3-2631-4173-90e3-15335cbd5a57 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:43.526590 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-71b73cd3-2631-4173-90e3-15335cbd5a57 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.512662 Aug 24 16:55:43.526995 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 350/700] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:43 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:44.033458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:44.034677 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:44.045316 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:44.045602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:44.046203 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:44.051134 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-c163a7fb-4840-40c1-8ab0-80db4f7c3aee req-2010dcca-948f-40ad-ae03-266668293b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d1714b-1531-428f-a205-e42cedf76d9b", "tag": "629e65e7-9a31-4acf-8a66-2220e5591487"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:44.059121 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:44.059800 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:44.060232 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:44.064907 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-c163a7fb-4840-40c1-8ab0-80db4f7c3aee req-2010dcca-948f-40ad-ae03-266668293b86 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:44.065383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-c163a7fb-4840-40c1-8ab0-80db4f7c3aee req-2010dcca-948f-40ad-ae03-266668293b86 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:44.065812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-c163a7fb-4840-40c1-8ab0-80db4f7c3aee req-2010dcca-948f-40ad-ae03-266668293b86 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:44.080436 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-c163a7fb-4840-40c1-8ab0-80db4f7c3aee req-2010dcca-948f-40ad-ae03-266668293b86 service nova] Creating event network-changed:629e65e7-9a31-4acf-8a66-2220e5591487 for instance 09d1714b-1531-428f-a205-e42cedf76d9b on hv-cinder-85220 Aug 24 16:55:44.084068 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:44.086228 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-c163a7fb-4840-40c1-8ab0-80db4f7c3aee req-2010dcca-948f-40ad-ae03-266668293b86 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038569 Aug 24 16:55:44.090457 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 351/701] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:44.094505 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:44.094988 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:44.095421 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:44.095865 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lazy-loading 'fault' on Instance uuid dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:55:44.143623 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45913fc3d9ba42ea9e971db25e656c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f5635b43e74a96a56d56cccbc111b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:44.156374 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2fef1cab-e5f4-4626-88ec-295bc4988f39 tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 200 len: 1310 microversion: 2.1 time: 0.126051 Aug 24 16:55:44.157737 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 351/702] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:44 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 1310 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:44.549000 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0e69a79a-6021-4a0e-b6be-91b19acd2556 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:44.549779 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0e69a79a-6021-4a0e-b6be-91b19acd2556 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:44.556564 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e69a79a-6021-4a0e-b6be-91b19acd2556 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:44.557137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e69a79a-6021-4a0e-b6be-91b19acd2556 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:44.557633 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e69a79a-6021-4a0e-b6be-91b19acd2556 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:44.558341 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e69a79a-6021-4a0e-b6be-91b19acd2556 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:44.568966 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e69a79a-6021-4a0e-b6be-91b19acd2556 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:44.568966 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e69a79a-6021-4a0e-b6be-91b19acd2556 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:44.715608 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0e69a79a-6021-4a0e-b6be-91b19acd2556 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:44.724031 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0e69a79a-6021-4a0e-b6be-91b19acd2556 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.180508 Aug 24 16:55:44.738324 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 352/703] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:44 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:45.177725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4fa5f2ad-6147-447f-8a43-cd88fa22c57d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:45.178329 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4fa5f2ad-6147-447f-8a43-cd88fa22c57d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] [instance: dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:45.190771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4fa5f2ad-6147-447f-8a43-cd88fa22c57d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:45.190771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4fa5f2ad-6147-447f-8a43-cd88fa22c57d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:45.190771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4fa5f2ad-6147-447f-8a43-cd88fa22c57d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:45.190771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4fa5f2ad-6147-447f-8a43-cd88fa22c57d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:45.191109 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4fa5f2ad-6147-447f-8a43-cd88fa22c57d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:45.191109 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4fa5f2ad-6147-447f-8a43-cd88fa22c57d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:45.201654 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-4fa5f2ad-6147-447f-8a43-cd88fa22c57d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] HTTP exception thrown: Instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b could not be found. Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4fa5f2ad-6147-447f-8a43-cd88fa22c57d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Request method failure captured: Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b HTTP/1.1 Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZISQVjDYN-eIogkcFZs4LwnKoC8sLc9FZzdslGTzUrTNQWcUS4KZag3pL6aq7dRyIc2KFLdQFiK-4WL410C3YKTO4TmPCffofqSVR3WjOCdAkm3OD1T4kuqoqivwNCWFfuz5cdlLKVbaudAbBuC_4ZmqoIRB4h0CNWV89o1uMxmgw Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 42f5635b43e74a96a56d56cccbc111b5 Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:55:45.203313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:55:45.204872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42f5635b43e74a96a56d56cccbc111b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:55:45.204872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:55:45.204872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 42f5635b43e74a96a56d56cccbc111b5 Aug 24 16:55:45.204872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-175432080 Aug 24 16:55:45.204872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-ServerRescueNegativeTestJSON-175432080-project Aug 24 16:55:45.204872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:55:45.204872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:55:45.204872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 45913fc3d9ba42ea9e971db25e656c61 Aug 24 16:55:45.204872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-175432080-project Aug 24 16:55:45.204872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:55:45.204872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b could not be found. Aug 24 16:55:45.204872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': 'dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b'} Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b could not be found. Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:45.213343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b could not be found. Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b could not be found. Aug 24 16:55:45.214951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:55:45.216157 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4fa5f2ad-6147-447f-8a43-cd88fa22c57d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] Returning 404 to user: Instance dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:45.216157 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4fa5f2ad-6147-447f-8a43-cd88fa22c57d tempest-ServerRescueNegativeTestJSON-175432080 tempest-ServerRescueNegativeTestJSON-175432080-project] 10.222.0.70 "GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b" status: 404 len: 111 microversion: 2.1 time: 0.030829 Aug 24 16:55:45.216157 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 352/704] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:45 2022] GET /compute/v2.1/servers/dcd2d52f-3fa2-4b50-8dc4-ed08abed4e5b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:55:45.746304 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-89da847a-67b1-4b0c-bedd-c9143d1673f8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:45.746917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-89da847a-67b1-4b0c-bedd-c9143d1673f8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:45.749370 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:45.754193 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89da847a-67b1-4b0c-bedd-c9143d1673f8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:45.754678 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89da847a-67b1-4b0c-bedd-c9143d1673f8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:45.755107 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89da847a-67b1-4b0c-bedd-c9143d1673f8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:45.755790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89da847a-67b1-4b0c-bedd-c9143d1673f8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:45.756541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89da847a-67b1-4b0c-bedd-c9143d1673f8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:45.758074 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89da847a-67b1-4b0c-bedd-c9143d1673f8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:45.892031 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-89da847a-67b1-4b0c-bedd-c9143d1673f8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:45.900366 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-89da847a-67b1-4b0c-bedd-c9143d1673f8 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1510 microversion: 2.1 time: 0.158528 Aug 24 16:55:45.900979 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 353/705] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:45 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:45.921077 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c5fd691e-d6b9-428b-a2d0-e522f682c8c0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:45.921683 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c5fd691e-d6b9-428b-a2d0-e522f682c8c0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:45.927588 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c5fd691e-d6b9-428b-a2d0-e522f682c8c0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:45.928074 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c5fd691e-d6b9-428b-a2d0-e522f682c8c0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:45.928546 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c5fd691e-d6b9-428b-a2d0-e522f682c8c0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:45.929303 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c5fd691e-d6b9-428b-a2d0-e522f682c8c0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:45.929705 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c5fd691e-d6b9-428b-a2d0-e522f682c8c0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:45.930133 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c5fd691e-d6b9-428b-a2d0-e522f682c8c0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:45.972297 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c5fd691e-d6b9-428b-a2d0-e522f682c8c0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127715) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 16:55:46.218803 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c5fd691e-d6b9-428b-a2d0-e522f682c8c0 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "POST /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91/action" status: 202 len: 0 microversion: 2.1 time: 0.301640 Aug 24 16:55:46.219460 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 353/706] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 16:55:45 2022] POST /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:55:46.228070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-03fe1e5a-c89c-4056-bf0a-95860adbdd6c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:46.228710 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-03fe1e5a-c89c-4056-bf0a-95860adbdd6c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:46.234569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03fe1e5a-c89c-4056-bf0a-95860adbdd6c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:46.239052 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03fe1e5a-c89c-4056-bf0a-95860adbdd6c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:46.239052 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03fe1e5a-c89c-4056-bf0a-95860adbdd6c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:46.239052 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03fe1e5a-c89c-4056-bf0a-95860adbdd6c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:46.239052 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03fe1e5a-c89c-4056-bf0a-95860adbdd6c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:46.239448 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03fe1e5a-c89c-4056-bf0a-95860adbdd6c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:46.384339 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-03fe1e5a-c89c-4056-bf0a-95860adbdd6c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:46.393605 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-03fe1e5a-c89c-4056-bf0a-95860adbdd6c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1518 microversion: 2.1 time: 0.169667 Aug 24 16:55:46.400478 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 354/707] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:46 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:47.222359 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-ebe57542-457a-4fd7-9294-f99ac391ff9c req-d981e93f-1c06-4be5-8304-f494c673e545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62dfce7d-d2d5-4695-948f-8381f4ea6a91", "name": "network-vif-unplugged", "status": "completed", "tag": "3cf062b3-088f-4bbb-91b9-d4ca915fdc9c"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:47.232001 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-ebe57542-457a-4fd7-9294-f99ac391ff9c req-d981e93f-1c06-4be5-8304-f494c673e545 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:47.232647 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-ebe57542-457a-4fd7-9294-f99ac391ff9c req-d981e93f-1c06-4be5-8304-f494c673e545 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:47.233162 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-ebe57542-457a-4fd7-9294-f99ac391ff9c req-d981e93f-1c06-4be5-8304-f494c673e545 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:47.246128 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.compute.server_external_events [req-ebe57542-457a-4fd7-9294-f99ac391ff9c req-d981e93f-1c06-4be5-8304-f494c673e545 service nova] Unable to find a host for instance 62dfce7d-d2d5-4695-948f-8381f4ea6a91. Dropping event network-vif-unplugged {{(pid=127715) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 16:55:47.247055 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-ebe57542-457a-4fd7-9294-f99ac391ff9c req-d981e93f-1c06-4be5-8304-f494c673e545 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036377 Aug 24 16:55:47.247860 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 354/708] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 16:55:47.417971 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6c11ab53-bcbd-4473-90d9-14176d0e7b6b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:47.419237 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6c11ab53-bcbd-4473-90d9-14176d0e7b6b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:47.425738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c11ab53-bcbd-4473-90d9-14176d0e7b6b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:47.426489 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c11ab53-bcbd-4473-90d9-14176d0e7b6b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:47.426696 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c11ab53-bcbd-4473-90d9-14176d0e7b6b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:47.427429 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c11ab53-bcbd-4473-90d9-14176d0e7b6b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:47.427875 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c11ab53-bcbd-4473-90d9-14176d0e7b6b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:47.428296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c11ab53-bcbd-4473-90d9-14176d0e7b6b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:47.559935 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6c11ab53-bcbd-4473-90d9-14176d0e7b6b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:47.568289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6c11ab53-bcbd-4473-90d9-14176d0e7b6b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1518 microversion: 2.1 time: 0.155231 Aug 24 16:55:47.568896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 355/709] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:47 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:48.593420 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-743d2583-0f17-4e72-a115-ce83e7a26255 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:48.598644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-743d2583-0f17-4e72-a115-ce83e7a26255 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:48.611669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-743d2583-0f17-4e72-a115-ce83e7a26255 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:48.611669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-743d2583-0f17-4e72-a115-ce83e7a26255 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:48.611669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-743d2583-0f17-4e72-a115-ce83e7a26255 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:48.611669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-743d2583-0f17-4e72-a115-ce83e7a26255 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:48.612147 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-743d2583-0f17-4e72-a115-ce83e7a26255 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:48.612293 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-743d2583-0f17-4e72-a115-ce83e7a26255 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:48.854817 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-743d2583-0f17-4e72-a115-ce83e7a26255 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:48.863763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-743d2583-0f17-4e72-a115-ce83e7a26255 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1520 microversion: 2.1 time: 0.275482 Aug 24 16:55:48.865060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 355/710] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:48 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:49.888144 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c8467df3-991d-4994-80f0-5e6337e1703d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:49.889649 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c8467df3-991d-4994-80f0-5e6337e1703d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:49.900698 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c8467df3-991d-4994-80f0-5e6337e1703d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:49.902038 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c8467df3-991d-4994-80f0-5e6337e1703d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:49.902703 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c8467df3-991d-4994-80f0-5e6337e1703d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:49.904820 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c8467df3-991d-4994-80f0-5e6337e1703d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:49.905778 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c8467df3-991d-4994-80f0-5e6337e1703d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:49.906412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c8467df3-991d-4994-80f0-5e6337e1703d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:50.063248 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c8467df3-991d-4994-80f0-5e6337e1703d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:50.071174 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c8467df3-991d-4994-80f0-5e6337e1703d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.188805 Aug 24 16:55:50.072368 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 356/711] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:49 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:51.093252 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-55d94eeb-ac81-4921-be01-240a23319b5c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:51.093879 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-55d94eeb-ac81-4921-be01-240a23319b5c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:51.100285 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55d94eeb-ac81-4921-be01-240a23319b5c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:51.100813 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55d94eeb-ac81-4921-be01-240a23319b5c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:51.101256 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55d94eeb-ac81-4921-be01-240a23319b5c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:51.101953 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55d94eeb-ac81-4921-be01-240a23319b5c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:51.102412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55d94eeb-ac81-4921-be01-240a23319b5c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:51.102865 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55d94eeb-ac81-4921-be01-240a23319b5c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:51.121483 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:51.138577 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3c16804d-33d7-4b8d-a34c-6d365ccf925c tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Action: 'create', calling method: .version_select at 0x7fa1949a8af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1210426092"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:51.236032 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-55d94eeb-ac81-4921-be01-240a23319b5c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:51.244901 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-55d94eeb-ac81-4921-be01-240a23319b5c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.155400 Aug 24 16:55:51.246488 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 357/712] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:51 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:51.879531 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3c16804d-33d7-4b8d-a34c-6d365ccf925c tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.855614 Aug 24 16:55:51.880150 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 356/713] 10.222.0.70 () {60 vars in 1155 bytes} [Wed Aug 24 16:55:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 857 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 16:55:51.893307 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2bee101e-1ddf-4286-80f2-4bcc7e6d778f tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa1992b1820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:51.945340 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2bee101e-1ddf-4286-80f2-4bcc7e6d778f tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985" status: 200 len: 345 microversion: 2.1 time: 0.056041 Aug 24 16:55:51.946116 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 358/714] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 16:55:51 2022] GET /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:52.266670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c6f067e1-af20-46a0-9368-38127f24ab3b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:52.267282 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c6f067e1-af20-46a0-9368-38127f24ab3b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:52.273813 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6f067e1-af20-46a0-9368-38127f24ab3b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:52.274296 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6f067e1-af20-46a0-9368-38127f24ab3b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:52.274734 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6f067e1-af20-46a0-9368-38127f24ab3b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:52.275419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6f067e1-af20-46a0-9368-38127f24ab3b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:52.275905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6f067e1-af20-46a0-9368-38127f24ab3b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:52.276337 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6f067e1-af20-46a0-9368-38127f24ab3b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:52.406396 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c6f067e1-af20-46a0-9368-38127f24ab3b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:52.414109 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c6f067e1-af20-46a0-9368-38127f24ab3b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.151858 Aug 24 16:55:52.415218 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 357/715] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:52 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:52.960495 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-165a49b7-9551-4662-8150-3a575e94f892 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa1992469d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:53.007102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-165a49b7-9551-4662-8150-3a575e94f892 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985" status: 200 len: 346 microversion: 2.1 time: 0.050975 Aug 24 16:55:53.007781 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 359/716] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 16:55:52 2022] GET /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:53.020652 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-957c3e95-8213-4363-bc17-edf0e4132594 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Action: 'create', calling method: .version_select at 0x7fa194955f70>, body: {"snapshot": {"volume_id": "aad9bb33-24af-43f7-a547-e2c7a6e6f985", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1262350079"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:53.445221 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1d3e4aeb-ff5b-4173-8341-345f10c2ae09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:53.445221 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1d3e4aeb-ff5b-4173-8341-345f10c2ae09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:53.445221 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d3e4aeb-ff5b-4173-8341-345f10c2ae09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:53.445221 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d3e4aeb-ff5b-4173-8341-345f10c2ae09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:53.445843 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d3e4aeb-ff5b-4173-8341-345f10c2ae09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:53.445843 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d3e4aeb-ff5b-4173-8341-345f10c2ae09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:53.446383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d3e4aeb-ff5b-4173-8341-345f10c2ae09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:53.447380 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d3e4aeb-ff5b-4173-8341-345f10c2ae09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:53.575606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1d3e4aeb-ff5b-4173-8341-345f10c2ae09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:53.583531 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1d3e4aeb-ff5b-4173-8341-345f10c2ae09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.150544 Aug 24 16:55:53.584096 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 360/717] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:53 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:53.741855 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-957c3e95-8213-4363-bc17-edf0e4132594 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.725015 Aug 24 16:55:53.742538 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 358/718] 10.222.0.70 () {60 vars in 1162 bytes} [Wed Aug 24 16:55:53 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:53.759272 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-baa39b96-3775-4b6f-93cb-2d77743fea71 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa1991f51f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:53.783110 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-baa39b96-3775-4b6f-93cb-2d77743fea71 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b" status: 200 len: 287 microversion: 2.1 time: 0.033053 Aug 24 16:55:53.783744 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 361/719] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Aug 24 16:55:53 2022] GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:53.794864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ccf57975-65a1-40c4-a58b-699b55e0972b tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa194877550>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:53.833645 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ccf57975-65a1-40c4-a58b-699b55e0972b tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035124 Aug 24 16:55:53.833645 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 359/720] 10.222.0.70 () {58 vars in 1140 bytes} [Wed Aug 24 16:55:53 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:53.837753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-96877581-7e0f-4f50-9c6a-92175847f69c tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa199246d30>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:53.866969 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-96877581-7e0f-4f50-9c6a-92175847f69c tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b" status: 200 len: 287 microversion: 2.1 time: 0.033469 Aug 24 16:55:53.867608 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 362/721] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Aug 24 16:55:53 2022] GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:54.605101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5c1e6299-2407-4419-8dbb-046ca60be36c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:54.605746 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5c1e6299-2407-4419-8dbb-046ca60be36c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:54.611688 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5c1e6299-2407-4419-8dbb-046ca60be36c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:54.612170 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5c1e6299-2407-4419-8dbb-046ca60be36c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:54.612647 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5c1e6299-2407-4419-8dbb-046ca60be36c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:54.613338 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5c1e6299-2407-4419-8dbb-046ca60be36c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:54.613795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5c1e6299-2407-4419-8dbb-046ca60be36c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:54.614220 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5c1e6299-2407-4419-8dbb-046ca60be36c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:54.771434 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-5c1e6299-2407-4419-8dbb-046ca60be36c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:54.779171 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5c1e6299-2407-4419-8dbb-046ca60be36c tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.178603 Aug 24 16:55:54.779740 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 360/722] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:54 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:54.880043 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c42c9bee-ec6f-46d6-ac3a-9d4206716e6e tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa1991fc0d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:54.909669 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c42c9bee-ec6f-46d6-ac3a-9d4206716e6e tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b" status: 200 len: 287 microversion: 2.1 time: 0.034148 Aug 24 16:55:54.910233 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 363/723] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Aug 24 16:55:54 2022] GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:55.799853 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-dc918c62-515b-48f2-9cd8-e70c5fa4841e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:55.800426 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-dc918c62-515b-48f2-9cd8-e70c5fa4841e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:55.807002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dc918c62-515b-48f2-9cd8-e70c5fa4841e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:55.807483 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dc918c62-515b-48f2-9cd8-e70c5fa4841e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:55.807941 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dc918c62-515b-48f2-9cd8-e70c5fa4841e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:55.808678 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dc918c62-515b-48f2-9cd8-e70c5fa4841e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:55.809129 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dc918c62-515b-48f2-9cd8-e70c5fa4841e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:55.809550 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-dc918c62-515b-48f2-9cd8-e70c5fa4841e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:55.922826 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-19342c16-97d6-4f2f-851b-2268ec602530 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa1991f5b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:55.943223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-dc918c62-515b-48f2-9cd8-e70c5fa4841e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:55.950949 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-dc918c62-515b-48f2-9cd8-e70c5fa4841e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.154891 Aug 24 16:55:55.951373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 361/724] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:55 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:55.953191 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-19342c16-97d6-4f2f-851b-2268ec602530 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b" status: 200 len: 287 microversion: 2.1 time: 0.034809 Aug 24 16:55:55.953795 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 364/725] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Aug 24 16:55:55 2022] GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:55:56.965702 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fdde68e4-e08b-49fc-a324-947ac6043383 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa1948830d0>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:56.972043 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fe120ce3-7583-4c11-92e6-d30de85b385d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:56.973254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fe120ce3-7583-4c11-92e6-d30de85b385d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:56.982153 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe120ce3-7583-4c11-92e6-d30de85b385d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:56.982643 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe120ce3-7583-4c11-92e6-d30de85b385d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:56.983092 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe120ce3-7583-4c11-92e6-d30de85b385d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:56.983792 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe120ce3-7583-4c11-92e6-d30de85b385d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:56.984245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe120ce3-7583-4c11-92e6-d30de85b385d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:56.984694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe120ce3-7583-4c11-92e6-d30de85b385d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:56.999661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fdde68e4-e08b-49fc-a324-947ac6043383 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b" status: 200 len: 287 microversion: 2.1 time: 0.033513 Aug 24 16:55:57.000257 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 362/726] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Aug 24 16:55:56 2022] GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:57.118926 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fe120ce3-7583-4c11-92e6-d30de85b385d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:57.127245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fe120ce3-7583-4c11-92e6-d30de85b385d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.159221 Aug 24 16:55:57.127805 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 365/727] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:56 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:55:58.013215 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8996e540-adf6-4cfc-a26b-33ccf102c6aa tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa1949a8940>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:58.042754 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8996e540-adf6-4cfc-a26b-33ccf102c6aa tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b" status: 200 len: 287 microversion: 2.1 time: 0.033829 Aug 24 16:55:58.043393 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 363/728] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Aug 24 16:55:58 2022] GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:58.148487 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2683b386-9995-4a90-81ff-228de36bebdc tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:58.149122 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2683b386-9995-4a90-81ff-228de36bebdc tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:58.155582 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2683b386-9995-4a90-81ff-228de36bebdc tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:58.156102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2683b386-9995-4a90-81ff-228de36bebdc tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:58.156574 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2683b386-9995-4a90-81ff-228de36bebdc tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:58.157266 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2683b386-9995-4a90-81ff-228de36bebdc tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:58.157721 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2683b386-9995-4a90-81ff-228de36bebdc tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:58.158166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2683b386-9995-4a90-81ff-228de36bebdc tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:58.286490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2683b386-9995-4a90-81ff-228de36bebdc tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:58.294674 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2683b386-9995-4a90-81ff-228de36bebdc tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.150069 Aug 24 16:55:58.295235 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 366/729] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:58 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:59.055906 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e5bce857-5237-405b-8da3-fbd532327657 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa194897a60>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:59.086755 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e5bce857-5237-405b-8da3-fbd532327657 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b" status: 200 len: 288 microversion: 2.1 time: 0.035076 Aug 24 16:55:59.087916 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 364/730] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Aug 24 16:55:59 2022] GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:59.098784 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8157d5bb-1887-462d-8bf5-9226279ebd5a tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa1991fcf70>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:59.216663 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8157d5bb-1887-462d-8bf5-9226279ebd5a tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b" status: 202 len: 0 microversion: 2.1 time: 0.121480 Aug 24 16:55:59.217240 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 367/731] 10.222.0.70 () {58 vars in 1254 bytes} [Wed Aug 24 16:55:59 2022] DELETE /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:55:59.225417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-09f6395c-133b-41cf-b384-1b545b4779fa tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa194955f70>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:59.254807 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-09f6395c-133b-41cf-b384-1b545b4779fa tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b" status: 200 len: 287 microversion: 2.1 time: 0.033329 Aug 24 16:55:59.255369 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 365/732] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Aug 24 16:55:59 2022] GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:59.316298 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cbc0f0a0-838e-4cf2-a247-12aac814cb09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:59.316854 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cbc0f0a0-838e-4cf2-a247-12aac814cb09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:59.323392 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cbc0f0a0-838e-4cf2-a247-12aac814cb09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:59.323862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cbc0f0a0-838e-4cf2-a247-12aac814cb09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:59.324289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cbc0f0a0-838e-4cf2-a247-12aac814cb09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:59.324999 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cbc0f0a0-838e-4cf2-a247-12aac814cb09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:59.325446 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cbc0f0a0-838e-4cf2-a247-12aac814cb09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:59.325865 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cbc0f0a0-838e-4cf2-a247-12aac814cb09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:59.460050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cbc0f0a0-838e-4cf2-a247-12aac814cb09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:59.467777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cbc0f0a0-838e-4cf2-a247-12aac814cb09 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.155441 Aug 24 16:55:59.468348 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 368/733] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:59 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:00.267464 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a8f8f7f6-2524-4d2b-8bc0-69e464031142 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa194883940>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:00.292255 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-a8f8f7f6-2524-4d2b-8bc0-69e464031142 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] HTTP exception thrown: Snapshot b64f19d0-6204-411d-996b-2d70f74d059b could not be found. Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a8f8f7f6-2524-4d2b-8bc0-69e464031142 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Request method failure captured: Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b HTTP/1.1 Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlgWfLECk-qRyipGMPxn3uU-SG6SEdmivzF8Dkdj_LVaJTnh4dUd3wEqcYYI7P64FxZ7w0KskBe9JcsmTCzNW7DQ4Rn07pHz5pLhM1SpW5Vy1gQGml_H32rfsqAQIKt6DkCi7xh6lMpTEOtMPZr091ldWvJveSB_OFqyVXgdKXq3tPM Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 26bd4ee5713f49b7af4b823f270e7b5f Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1131512046 Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:56:00.294526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:56:00.296059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:56:00.296059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1131512046 Aug 24 16:56:00.296059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 26bd4ee5713f49b7af4b823f270e7b5f Aug 24 16:56:00.296059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1131512046 Aug 24 16:56:00.296059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-VolumesSnapshotsTestJSON-1131512046-project Aug 24 16:56:00.296059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:56:00.296059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:56:00.296059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 41b5b802c50d4d1cbb6314eebed4c75d Aug 24 16:56:00.296059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1131512046-project Aug 24 16:56:00.296059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: Aug 24 16:56:00.296059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Snapshot b64f19d0-6204-411d-996b-2d70f74d059b could not be found. Aug 24 16:56:00.296059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': 'b64f19d0-6204-411d-996b-2d70f74d059b'} Aug 24 16:56:00.296059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b64f19d0-6204-411d-996b-2d70f74d059b could not be found. (HTTP 404) (Request-ID: req-e1949c30-8fc8-4981-98a0-23c3b57429a4) Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:56:00.297004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:56:00.298119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b64f19d0-6204-411d-996b-2d70f74d059b could not be found. Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 16:56:00.299235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:56:00.300470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b64f19d0-6204-411d-996b-2d70f74d059b could not be found. Aug 24 16:56:00.300470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:56:00.300470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:00.300470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:56:00.300470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:00.300470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:56:00.300470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:56:00.300470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:56:00.300470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:56:00.300470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b64f19d0-6204-411d-996b-2d70f74d059b could not be found. Aug 24 16:56:00.300470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:56:00.300470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a8f8f7f6-2524-4d2b-8bc0-69e464031142 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Returning 404 to user: Snapshot b64f19d0-6204-411d-996b-2d70f74d059b could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:56:00.300470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a8f8f7f6-2524-4d2b-8bc0-69e464031142 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b" status: 404 len: 111 microversion: 2.1 time: 0.032774 Aug 24 16:56:00.301428 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 366/734] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Aug 24 16:56:00 2022] GET /compute/v2.1/os-snapshots/b64f19d0-6204-411d-996b-2d70f74d059b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:56:00.304570 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c5e9d19f-f4f4-40b0-8fdf-de13e29e3fa6 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa199224700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:00.491483 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3d8038b5-5ec6-4839-bf2a-01339dfd557b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:00.492092 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3d8038b5-5ec6-4839-bf2a-01339dfd557b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:00.498031 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d8038b5-5ec6-4839-bf2a-01339dfd557b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:00.498520 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d8038b5-5ec6-4839-bf2a-01339dfd557b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:00.498962 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d8038b5-5ec6-4839-bf2a-01339dfd557b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:00.499653 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d8038b5-5ec6-4839-bf2a-01339dfd557b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:00.500130 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d8038b5-5ec6-4839-bf2a-01339dfd557b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:00.500571 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d8038b5-5ec6-4839-bf2a-01339dfd557b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:00.546422 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c5e9d19f-f4f4-40b0-8fdf-de13e29e3fa6 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985" status: 202 len: 0 microversion: 2.1 time: 0.245589 Aug 24 16:56:00.546998 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 369/735] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Aug 24 16:56:00 2022] DELETE /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:56:00.555230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-33140404-34b8-4656-b87f-f3a4fd7968c8 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa194b36940>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:00.604582 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-33140404-34b8-4656-b87f-f3a4fd7968c8 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985" status: 200 len: 345 microversion: 2.1 time: 0.052935 Aug 24 16:56:00.605160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 370/736] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 16:56:00 2022] GET /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:56:00.636325 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3d8038b5-5ec6-4839-bf2a-01339dfd557b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:00.644219 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3d8038b5-5ec6-4839-bf2a-01339dfd557b tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.159193 Aug 24 16:56:00.644820 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 367/737] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:00 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:56:01.619308 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fe352c3e-7d15-486e-ab57-db0c2c894498 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa1992b29d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:01.647295 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-fe352c3e-7d15-486e-ab57-db0c2c894498 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] HTTP exception thrown: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fe352c3e-7d15-486e-ab57-db0c2c894498 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Request method failure captured: Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985 HTTP/1.1 Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlgWfLECk-qRyipGMPxn3uU-SG6SEdmivzF8Dkdj_LVaJTnh4dUd3wEqcYYI7P64FxZ7w0KskBe9JcsmTCzNW7DQ4Rn07pHz5pLhM1SpW5Vy1gQGml_H32rfsqAQIKt6DkCi7xh6lMpTEOtMPZr091ldWvJveSB_OFqyVXgdKXq3tPM Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 26bd4ee5713f49b7af4b823f270e7b5f Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1131512046 Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:56:01.650750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:56:01.652178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:56:01.652178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1131512046 Aug 24 16:56:01.652178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 26bd4ee5713f49b7af4b823f270e7b5f Aug 24 16:56:01.652178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1131512046 Aug 24 16:56:01.652178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-VolumesSnapshotsTestJSON-1131512046-project Aug 24 16:56:01.652178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:56:01.652178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:56:01.652178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 41b5b802c50d4d1cbb6314eebed4c75d Aug 24 16:56:01.652178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1131512046-project Aug 24 16:56:01.652178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: Aug 24 16:56:01.652178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.652178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': 'aad9bb33-24af-43f7-a547-e2c7a6e6f985'} Aug 24 16:56:01.652178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. (HTTP 404) (Request-ID: req-8c263f65-977f-491d-ba12-48846ba9f6cc) Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:01.653034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:56:01.654195 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 16:56:01.655299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fe352c3e-7d15-486e-ab57-db0c2c894498 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Returning 404 to user: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fe352c3e-7d15-486e-ab57-db0c2c894498 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985" status: 404 len: 109 microversion: 2.1 time: 0.037897 Aug 24 16:56:01.656418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 371/738] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 16:56:01 2022] GET /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:56:01.664066 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ab4f482b-68a4-430a-a5ab-cc0e3e111484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:01.664703 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ab4f482b-68a4-430a-a5ab-cc0e3e111484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:01.666649 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-43323545-9ac6-4cfa-9a0c-87d1592b84d1 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa1992b2280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:01.671244 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab4f482b-68a4-430a-a5ab-cc0e3e111484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:01.671747 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab4f482b-68a4-430a-a5ab-cc0e3e111484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:01.672320 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab4f482b-68a4-430a-a5ab-cc0e3e111484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:01.673071 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab4f482b-68a4-430a-a5ab-cc0e3e111484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:01.673531 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab4f482b-68a4-430a-a5ab-cc0e3e111484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:01.673993 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab4f482b-68a4-430a-a5ab-cc0e3e111484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:01.694355 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-43323545-9ac6-4cfa-9a0c-87d1592b84d1 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] HTTP exception thrown: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-43323545-9ac6-4cfa-9a0c-87d1592b84d1 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Request method failure captured: Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: DELETE /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985 HTTP/1.1 Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlgWfLECk-qRyipGMPxn3uU-SG6SEdmivzF8Dkdj_LVaJTnh4dUd3wEqcYYI7P64FxZ7w0KskBe9JcsmTCzNW7DQ4Rn07pHz5pLhM1SpW5Vy1gQGml_H32rfsqAQIKt6DkCi7xh6lMpTEOtMPZr091ldWvJveSB_OFqyVXgdKXq3tPM Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 26bd4ee5713f49b7af4b823f270e7b5f Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1131512046 Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:56:01.696351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:56:01.698861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:56:01.698861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1131512046 Aug 24 16:56:01.698861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 26bd4ee5713f49b7af4b823f270e7b5f Aug 24 16:56:01.698861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1131512046 Aug 24 16:56:01.698861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-VolumesSnapshotsTestJSON-1131512046-project Aug 24 16:56:01.698861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:56:01.698861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:56:01.698861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 41b5b802c50d4d1cbb6314eebed4c75d Aug 24 16:56:01.698861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1131512046-project Aug 24 16:56:01.698861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: Aug 24 16:56:01.698861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.698861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': 'aad9bb33-24af-43f7-a547-e2c7a6e6f985'} Aug 24 16:56:01.698861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. (HTTP 404) (Request-ID: req-ddc46f9d-1831-485c-8a6d-52de98afcd64) Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:01.699885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:56:01.701318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 16:56:01.702738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-43323545-9ac6-4cfa-9a0c-87d1592b84d1 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Returning 404 to user: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-43323545-9ac6-4cfa-9a0c-87d1592b84d1 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985" status: 404 len: 109 microversion: 2.1 time: 0.036507 Aug 24 16:56:01.704192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 372/739] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Aug 24 16:56:01 2022] DELETE /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:56:01.709927 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c6c1686f-17da-48c4-a4b9-0a4d91d07548 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Calling method '.version_select at 0x7fa1992b1ca0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:01.737494 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-c6c1686f-17da-48c4-a4b9-0a4d91d07548 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] HTTP exception thrown: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c6c1686f-17da-48c4-a4b9-0a4d91d07548 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Request method failure captured: Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985 HTTP/1.1 Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlgWfLECk-qRyipGMPxn3uU-SG6SEdmivzF8Dkdj_LVaJTnh4dUd3wEqcYYI7P64FxZ7w0KskBe9JcsmTCzNW7DQ4Rn07pHz5pLhM1SpW5Vy1gQGml_H32rfsqAQIKt6DkCi7xh6lMpTEOtMPZr091ldWvJveSB_OFqyVXgdKXq3tPM Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 26bd4ee5713f49b7af4b823f270e7b5f Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1131512046 Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:56:01.739518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:56:01.741120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/26bd4ee5713f49b7af4b823f270e7b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:56:01.741120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1131512046 Aug 24 16:56:01.741120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 26bd4ee5713f49b7af4b823f270e7b5f Aug 24 16:56:01.741120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1131512046 Aug 24 16:56:01.741120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-VolumesSnapshotsTestJSON-1131512046-project Aug 24 16:56:01.741120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:56:01.741120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:56:01.741120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 41b5b802c50d4d1cbb6314eebed4c75d Aug 24 16:56:01.741120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1131512046-project Aug 24 16:56:01.741120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: Aug 24 16:56:01.741120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.741120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': 'aad9bb33-24af-43f7-a547-e2c7a6e6f985'} Aug 24 16:56:01.741120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. (HTTP 404) (Request-ID: req-96730a00-686d-45d5-8220-86c798522b55) Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:01.742050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:56:01.744066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 16:56:01.745383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c6c1686f-17da-48c4-a4b9-0a4d91d07548 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] Returning 404 to user: Volume aad9bb33-24af-43f7-a547-e2c7a6e6f985 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c6c1686f-17da-48c4-a4b9-0a4d91d07548 tempest-VolumesSnapshotsTestJSON-1131512046 tempest-VolumesSnapshotsTestJSON-1131512046-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985" status: 404 len: 109 microversion: 2.1 time: 0.036824 Aug 24 16:56:01.746581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 373/740] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 16:56:01 2022] GET /compute/v2.1/os-volumes/aad9bb33-24af-43f7-a547-e2c7a6e6f985 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:56:01.809737 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ab4f482b-68a4-430a-a5ab-cc0e3e111484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:01.817669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ab4f482b-68a4-430a-a5ab-cc0e3e111484 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.157581 Aug 24 16:56:01.818744 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 368/741] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:01 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:56:02.840151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4caa3e82-5133-46e0-92e8-f83e2ee1d48e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:02.840830 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4caa3e82-5133-46e0-92e8-f83e2ee1d48e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:02.847404 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4caa3e82-5133-46e0-92e8-f83e2ee1d48e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:02.847882 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4caa3e82-5133-46e0-92e8-f83e2ee1d48e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:02.848315 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4caa3e82-5133-46e0-92e8-f83e2ee1d48e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:02.854036 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4caa3e82-5133-46e0-92e8-f83e2ee1d48e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:02.854036 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4caa3e82-5133-46e0-92e8-f83e2ee1d48e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:02.854036 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4caa3e82-5133-46e0-92e8-f83e2ee1d48e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:02.980554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4caa3e82-5133-46e0-92e8-f83e2ee1d48e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:02.988129 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4caa3e82-5133-46e0-92e8-f83e2ee1d48e tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.152950 Aug 24 16:56:02.988717 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 374/742] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:02 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:03.367437 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-980b1598-3eaf-4374-ad1f-f1df5b067a96 req-b6471683-a960-4580-962c-3fd37e7399f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62dfce7d-d2d5-4695-948f-8381f4ea6a91", "name": "network-vif-plugged", "status": "completed", "tag": "3cf062b3-088f-4bbb-91b9-d4ca915fdc9c"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:56:03.375033 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-980b1598-3eaf-4374-ad1f-f1df5b067a96 req-b6471683-a960-4580-962c-3fd37e7399f5 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:03.375508 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-980b1598-3eaf-4374-ad1f-f1df5b067a96 req-b6471683-a960-4580-962c-3fd37e7399f5 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:03.375931 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-980b1598-3eaf-4374-ad1f-f1df5b067a96 req-b6471683-a960-4580-962c-3fd37e7399f5 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:03.389639 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-980b1598-3eaf-4374-ad1f-f1df5b067a96 req-b6471683-a960-4580-962c-3fd37e7399f5 service nova] Creating event network-vif-plugged:3cf062b3-088f-4bbb-91b9-d4ca915fdc9c for instance 62dfce7d-d2d5-4695-948f-8381f4ea6a91 on hv-cinder-85220 Aug 24 16:56:03.395002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-980b1598-3eaf-4374-ad1f-f1df5b067a96 req-b6471683-a960-4580-962c-3fd37e7399f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035509 Aug 24 16:56:03.395669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 369/743] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:56:04.009616 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e44be8fe-50a8-4c2a-b316-b956d8b29903 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:04.010189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e44be8fe-50a8-4c2a-b316-b956d8b29903 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:04.016653 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e44be8fe-50a8-4c2a-b316-b956d8b29903 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:04.017132 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e44be8fe-50a8-4c2a-b316-b956d8b29903 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:04.017564 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e44be8fe-50a8-4c2a-b316-b956d8b29903 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:04.018247 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e44be8fe-50a8-4c2a-b316-b956d8b29903 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:04.018692 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e44be8fe-50a8-4c2a-b316-b956d8b29903 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:04.019106 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e44be8fe-50a8-4c2a-b316-b956d8b29903 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:04.149445 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e44be8fe-50a8-4c2a-b316-b956d8b29903 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:04.157799 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e44be8fe-50a8-4c2a-b316-b956d8b29903 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.152109 Aug 24 16:56:04.158358 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 375/744] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:04 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:05.179928 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-20fabbb0-02ab-424e-a6ec-c9a7ac70645f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:05.180419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-20fabbb0-02ab-424e-a6ec-c9a7ac70645f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:05.187476 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20fabbb0-02ab-424e-a6ec-c9a7ac70645f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:05.187965 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20fabbb0-02ab-424e-a6ec-c9a7ac70645f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:05.188411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20fabbb0-02ab-424e-a6ec-c9a7ac70645f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:05.189318 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20fabbb0-02ab-424e-a6ec-c9a7ac70645f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:05.190911 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20fabbb0-02ab-424e-a6ec-c9a7ac70645f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:05.191199 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20fabbb0-02ab-424e-a6ec-c9a7ac70645f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:05.336891 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-20fabbb0-02ab-424e-a6ec-c9a7ac70645f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:05.344610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-20fabbb0-02ab-424e-a6ec-c9a7ac70645f tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1576 microversion: 2.1 time: 0.169917 Aug 24 16:56:05.345274 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 370/745] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:05 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:06.365755 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-356d276f-9511-49d4-9d23-fe6ff4bdbb87 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:06.366376 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-356d276f-9511-49d4-9d23-fe6ff4bdbb87 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:06.373349 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-356d276f-9511-49d4-9d23-fe6ff4bdbb87 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:06.373835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-356d276f-9511-49d4-9d23-fe6ff4bdbb87 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:06.374273 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-356d276f-9511-49d4-9d23-fe6ff4bdbb87 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:06.374964 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-356d276f-9511-49d4-9d23-fe6ff4bdbb87 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:06.375421 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-356d276f-9511-49d4-9d23-fe6ff4bdbb87 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:06.375846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-356d276f-9511-49d4-9d23-fe6ff4bdbb87 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:06.507562 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-356d276f-9511-49d4-9d23-fe6ff4bdbb87 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:56:06.515338 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-356d276f-9511-49d4-9d23-fe6ff4bdbb87 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1563 microversion: 2.1 time: 0.153475 Aug 24 16:56:06.515931 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 376/746] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:56:06 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:48.594358 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9a8840d2-b010-4d06-a571-0400613305e2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:48.595423 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9a8840d2-b010-4d06-a571-0400613305e2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:48.597697 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:48.598364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:48.603129 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a8840d2-b010-4d06-a571-0400613305e2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:48.603620 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a8840d2-b010-4d06-a571-0400613305e2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:48.604064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a8840d2-b010-4d06-a571-0400613305e2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:48.604790 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a8840d2-b010-4d06-a571-0400613305e2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:48.605255 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a8840d2-b010-4d06-a571-0400613305e2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:48.605685 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9a8840d2-b010-4d06-a571-0400613305e2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:48.629103 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9a8840d2-b010-4d06-a571-0400613305e2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/ips" status: 200 len: 150 microversion: 2.1 time: 0.038330 Aug 24 16:56:48.629863 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 371/747] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Aug 24 16:56:48 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:56:50.282165 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-31219bf7-9086-4f54-aaea-39a964b1ac67 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22c8a773-22fc-4701-949d-dac59fe5ea8c"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:56:50.285262 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-31219bf7-9086-4f54-aaea-39a964b1ac67 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:50.287369 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=23 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:50.288014 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=44 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:50.292796 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31219bf7-9086-4f54-aaea-39a964b1ac67 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:50.309398 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31219bf7-9086-4f54-aaea-39a964b1ac67 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:50.309398 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31219bf7-9086-4f54-aaea-39a964b1ac67 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:50.309398 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31219bf7-9086-4f54-aaea-39a964b1ac67 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:50.309398 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31219bf7-9086-4f54-aaea-39a964b1ac67 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:50.309773 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31219bf7-9086-4f54-aaea-39a964b1ac67 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:51.065923 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-31219bf7-9086-4f54-aaea-39a964b1ac67 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "POST /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.787674 Aug 24 16:56:51.066451 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 377/748] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 16:56:50 2022] POST /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-volume_attachments => generated 194 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:56:59.657223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6a4aaf3c-1052-4068-bb67-a8813bdb1e5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22c8a773-22fc-4701-949d-dac59fe5ea8c"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:56:59.659650 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6a4aaf3c-1052-4068-bb67-a8813bdb1e5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:59.668369 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a4aaf3c-1052-4068-bb67-a8813bdb1e5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:59.668944 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a4aaf3c-1052-4068-bb67-a8813bdb1e5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:59.669380 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a4aaf3c-1052-4068-bb67-a8813bdb1e5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:59.670079 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a4aaf3c-1052-4068-bb67-a8813bdb1e5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:59.670537 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a4aaf3c-1052-4068-bb67-a8813bdb1e5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:59.670959 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6a4aaf3c-1052-4068-bb67-a8813bdb1e5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:59.752619 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-6a4aaf3c-1052-4068-bb67-a8813bdb1e5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Invalid volume: volume 22c8a773-22fc-4701-949d-dac59fe5ea8c is already attached to instances: 80f7a331-c982-4209-87fb-bf041c901c56 Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6a4aaf3c-1052-4068-bb67-a8813bdb1e5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: POST /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-volume_attachments HTTP/1.1 Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 74 Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:56:59.754637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:56:59.756312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:56:59.756312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:56:59.756312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:56:59.756312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:56:59.756312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:56:59.756312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:56:59.756312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:56:59.756312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:56:59.756312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:56:59.756312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Aug 24 16:56:59.756312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {"volumeAttachment": {"volumeId": "22c8a773-22fc-4701-949d-dac59fe5ea8c"}} Aug 24 16:56:59.756312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Invalid volume: volume 22c8a773-22fc-4701-949d-dac59fe5ea8c is already attached to instances: 80f7a331-c982-4209-87fb-bf041c901c56 Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'server_id': '80f7a331-c982-4209-87fb-bf041c901c56', 'body': {'volumeAttachment': {'volumeId': '22c8a773-22fc-4701-949d-dac59fe5ea8c'}}} Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 22c8a773-22fc-4701-949d-dac59fe5ea8c is already attached to instances: 80f7a331-c982-4209-87fb-bf041c901c56 Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:56:59.757250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 22c8a773-22fc-4701-949d-dac59fe5ea8c is already attached to instances: 80f7a331-c982-4209-87fb-bf041c901c56 Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:56:59.759365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:56:59.762291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:56:59.762291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:56:59.762291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:56:59.762291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 22c8a773-22fc-4701-949d-dac59fe5ea8c is already attached to instances: 80f7a331-c982-4209-87fb-bf041c901c56 Aug 24 16:56:59.762291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:56:59.762291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6a4aaf3c-1052-4068-bb67-a8813bdb1e5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 400 to user: Invalid volume: volume 22c8a773-22fc-4701-949d-dac59fe5ea8c is already attached to instances: 80f7a331-c982-4209-87fb-bf041c901c56 {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:56:59.762291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6a4aaf3c-1052-4068-bb67-a8813bdb1e5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "POST /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102914 Aug 24 16:56:59.762291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 372/749] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 16:56:59 2022] POST /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:56:59.824741 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-461e46aa-7a1b-4231-bd69-ac2fd2e60030 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:56:59.825318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-461e46aa-7a1b-4231-bd69-ac2fd2e60030 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:56:59.831489 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-461e46aa-7a1b-4231-bd69-ac2fd2e60030 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:59.831969 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-461e46aa-7a1b-4231-bd69-ac2fd2e60030 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:59.832937 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-461e46aa-7a1b-4231-bd69-ac2fd2e60030 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:59.833620 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-461e46aa-7a1b-4231-bd69-ac2fd2e60030 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:56:59.834090 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-461e46aa-7a1b-4231-bd69-ac2fd2e60030 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:56:59.834494 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-461e46aa-7a1b-4231-bd69-ac2fd2e60030 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:56:59.916984 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-461e46aa-7a1b-4231-bd69-ac2fd2e60030 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lazy-loading 'services' on Instance uuid 80f7a331-c982-4209-87fb-bf041c901c56 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:57:00.117932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-461e46aa-7a1b-4231-bd69-ac2fd2e60030 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-volume_attachments/22c8a773-22fc-4701-949d-dac59fe5ea8c" status: 202 len: 0 microversion: 2.1 time: 0.297735 Aug 24 16:57:00.118783 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 378/750] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Aug 24 16:56:59 2022] DELETE /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-volume_attachments/22c8a773-22fc-4701-949d-dac59fe5ea8c => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:57:00.127391 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-21c871cc-4f67-4e5c-a634-149bb8eb08b2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:00.130415 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-21c871cc-4f67-4e5c-a634-149bb8eb08b2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:00.137056 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-21c871cc-4f67-4e5c-a634-149bb8eb08b2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:00.137545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-21c871cc-4f67-4e5c-a634-149bb8eb08b2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:00.138013 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-21c871cc-4f67-4e5c-a634-149bb8eb08b2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:00.138711 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-21c871cc-4f67-4e5c-a634-149bb8eb08b2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:00.139165 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-21c871cc-4f67-4e5c-a634-149bb8eb08b2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:00.139588 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-21c871cc-4f67-4e5c-a634-149bb8eb08b2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:00.169364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-21c871cc-4f67-4e5c-a634-149bb8eb08b2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045909 Aug 24 16:57:00.169928 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 373/751] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:57:00 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:01.183735 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d09631f6-01ae-4fe1-887a-056f1257bcef tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:01.186540 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d09631f6-01ae-4fe1-887a-056f1257bcef tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:01.193182 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d09631f6-01ae-4fe1-887a-056f1257bcef tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:01.193669 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d09631f6-01ae-4fe1-887a-056f1257bcef tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:01.194104 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d09631f6-01ae-4fe1-887a-056f1257bcef tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:01.194811 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d09631f6-01ae-4fe1-887a-056f1257bcef tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:01.195256 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d09631f6-01ae-4fe1-887a-056f1257bcef tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:01.195676 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d09631f6-01ae-4fe1-887a-056f1257bcef tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:01.225848 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d09631f6-01ae-4fe1-887a-056f1257bcef tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047358 Aug 24 16:57:01.226410 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 379/752] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:57:01 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:02.237927 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e343644a-224c-4c8c-8daf-b2a8daffab16 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:02.240705 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e343644a-224c-4c8c-8daf-b2a8daffab16 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:02.247615 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e343644a-224c-4c8c-8daf-b2a8daffab16 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:02.248099 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e343644a-224c-4c8c-8daf-b2a8daffab16 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:02.248575 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e343644a-224c-4c8c-8daf-b2a8daffab16 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:02.249272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e343644a-224c-4c8c-8daf-b2a8daffab16 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:02.249736 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e343644a-224c-4c8c-8daf-b2a8daffab16 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:02.250162 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e343644a-224c-4c8c-8daf-b2a8daffab16 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:02.279107 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e343644a-224c-4c8c-8daf-b2a8daffab16 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045101 Aug 24 16:57:02.279663 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 374/753] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:57:02 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:57:02.340722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-270b8fd4-bb36-46a0-a0ae-5602cd39ad9b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:02.341296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-270b8fd4-bb36-46a0-a0ae-5602cd39ad9b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:02.347529 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-270b8fd4-bb36-46a0-a0ae-5602cd39ad9b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:02.348554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-270b8fd4-bb36-46a0-a0ae-5602cd39ad9b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:02.348987 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-270b8fd4-bb36-46a0-a0ae-5602cd39ad9b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:02.349674 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-270b8fd4-bb36-46a0-a0ae-5602cd39ad9b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:02.350122 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-270b8fd4-bb36-46a0-a0ae-5602cd39ad9b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:02.350560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-270b8fd4-bb36-46a0-a0ae-5602cd39ad9b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:02.375731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-270b8fd4-bb36-46a0-a0ae-5602cd39ad9b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:57:02.741879 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-270b8fd4-bb36-46a0-a0ae-5602cd39ad9b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 204 len: 0 microversion: 2.1 time: 0.404784 Aug 24 16:57:02.742467 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 380/754] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:57:02 2022] DELETE /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:02.750727 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c6f561fa-7995-4720-8e69-c4edd448590e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:02.751440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c6f561fa-7995-4720-8e69-c4edd448590e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:02.758285 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6f561fa-7995-4720-8e69-c4edd448590e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:02.758716 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6f561fa-7995-4720-8e69-c4edd448590e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:02.759159 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6f561fa-7995-4720-8e69-c4edd448590e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:02.759865 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6f561fa-7995-4720-8e69-c4edd448590e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:02.760323 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6f561fa-7995-4720-8e69-c4edd448590e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:02.760779 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6f561fa-7995-4720-8e69-c4edd448590e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:02.897013 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c6f561fa-7995-4720-8e69-c4edd448590e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:02.905870 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c6f561fa-7995-4720-8e69-c4edd448590e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1680 microversion: 2.1 time: 0.158991 Aug 24 16:57:02.906448 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 375/755] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:02 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:57:03.928420 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ca535568-ce7b-490d-96da-5fc16098d357 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:03.929121 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ca535568-ce7b-490d-96da-5fc16098d357 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:03.935427 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca535568-ce7b-490d-96da-5fc16098d357 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:03.936466 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca535568-ce7b-490d-96da-5fc16098d357 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:03.936466 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca535568-ce7b-490d-96da-5fc16098d357 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:03.937028 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca535568-ce7b-490d-96da-5fc16098d357 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:03.937475 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca535568-ce7b-490d-96da-5fc16098d357 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:03.937894 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca535568-ce7b-490d-96da-5fc16098d357 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:04.067586 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ca535568-ce7b-490d-96da-5fc16098d357 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:04.075385 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ca535568-ce7b-490d-96da-5fc16098d357 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1680 microversion: 2.1 time: 0.152083 Aug 24 16:57:04.075951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 381/756] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:03 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:05.097420 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-955f7b65-bdec-4571-a984-23f6956e40a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:05.097970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-955f7b65-bdec-4571-a984-23f6956e40a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:05.104335 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-955f7b65-bdec-4571-a984-23f6956e40a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:05.104846 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-955f7b65-bdec-4571-a984-23f6956e40a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:05.105288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-955f7b65-bdec-4571-a984-23f6956e40a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:05.105985 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-955f7b65-bdec-4571-a984-23f6956e40a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:05.106454 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-955f7b65-bdec-4571-a984-23f6956e40a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:05.106885 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-955f7b65-bdec-4571-a984-23f6956e40a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:05.232290 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-955f7b65-bdec-4571-a984-23f6956e40a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:05.240611 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-955f7b65-bdec-4571-a984-23f6956e40a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1680 microversion: 2.1 time: 0.147064 Aug 24 16:57:05.241185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 376/757] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:05 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:06.048536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-935b2e0b-046d-4440-97ea-4245f7262e80 req-3c48b8f9-ef0b-47ee-afbf-4bec0999c6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f7a331-c982-4209-87fb-bf041c901c56", "name": "network-vif-deleted", "tag": "e8853a68-efa6-4529-b0a1-5cf984b3c130"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:06.059034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-935b2e0b-046d-4440-97ea-4245f7262e80 req-3c48b8f9-ef0b-47ee-afbf-4bec0999c6a0 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:06.061373 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-935b2e0b-046d-4440-97ea-4245f7262e80 req-3c48b8f9-ef0b-47ee-afbf-4bec0999c6a0 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:06.061373 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-935b2e0b-046d-4440-97ea-4245f7262e80 req-3c48b8f9-ef0b-47ee-afbf-4bec0999c6a0 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:06.073218 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-935b2e0b-046d-4440-97ea-4245f7262e80 req-3c48b8f9-ef0b-47ee-afbf-4bec0999c6a0 service nova] Creating event network-vif-deleted:e8853a68-efa6-4529-b0a1-5cf984b3c130 for instance 80f7a331-c982-4209-87fb-bf041c901c56 on hv-cinder-85220 Aug 24 16:57:06.078075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-935b2e0b-046d-4440-97ea-4245f7262e80 req-3c48b8f9-ef0b-47ee-afbf-4bec0999c6a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033214 Aug 24 16:57:06.078660 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 382/758] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:06.262628 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-08014536-d14a-4961-90f0-8b865b11f01e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:06.263251 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-08014536-d14a-4961-90f0-8b865b11f01e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:06.269689 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08014536-d14a-4961-90f0-8b865b11f01e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:06.270181 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08014536-d14a-4961-90f0-8b865b11f01e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:06.270619 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08014536-d14a-4961-90f0-8b865b11f01e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:06.271321 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08014536-d14a-4961-90f0-8b865b11f01e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:06.271978 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08014536-d14a-4961-90f0-8b865b11f01e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:06.272430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08014536-d14a-4961-90f0-8b865b11f01e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:06.342235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-08014536-d14a-4961-90f0-8b865b11f01e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:06.345740 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-08014536-d14a-4961-90f0-8b865b11f01e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 200 len: 1326 microversion: 2.1 time: 0.087475 Aug 24 16:57:06.346338 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 377/759] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:06 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 1326 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:57:07.367949 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5b53991d-a548-422b-9531-6a40d7311e0f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:07.368682 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5b53991d-a548-422b-9531-6a40d7311e0f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:07.374840 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b53991d-a548-422b-9531-6a40d7311e0f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:07.375323 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b53991d-a548-422b-9531-6a40d7311e0f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:07.375764 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b53991d-a548-422b-9531-6a40d7311e0f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:07.376563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b53991d-a548-422b-9531-6a40d7311e0f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:07.377020 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b53991d-a548-422b-9531-6a40d7311e0f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:07.377445 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b53991d-a548-422b-9531-6a40d7311e0f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:07.390743 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-5b53991d-a548-422b-9531-6a40d7311e0f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5b53991d-a548-422b-9531-6a40d7311e0f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 HTTP/1.1 Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:57:07.392335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:57:07.398560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:57:07.398560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:57:07.398560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:57:07.398560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:57:07.398560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:57:07.398560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:57:07.398560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:57:07.398560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:57:07.398560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:57:07.398560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:57:07.398560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:57:07.398560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '80f7a331-c982-4209-87fb-bf041c901c56'} Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:57:07.399583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:57:07.401160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:57:07.402635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5b53991d-a548-422b-9531-6a40d7311e0f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 404 to user: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:57:07.402635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5b53991d-a548-422b-9531-6a40d7311e0f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 404 len: 111 microversion: 2.1 time: 0.030517 Aug 24 16:57:07.402635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 383/760] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:07 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:57:07.412196 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d4c0bbf7-9b19-48d9-b653-fd6a3a3bd7e7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '.version_select at 0x7fa194955e50>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:07.500731 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d4c0bbf7-9b19-48d9-b653-fd6a3a3bd7e7 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883323140" status: 202 len: 0 microversion: 2.1 time: 0.101342 Aug 24 16:57:07.503541 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 378/761] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Aug 24 16:57:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883323140 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:57:08.209500 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-796d66f4-2da6-4fc4-8bf5-60a6f8325200 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Action: 'create', calling method: .version_select at 0x7fa1992463a0>, body: {"keypair": {"name": "tempest-keypair-1513236172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn2ipcctt55THZO/XUAs/5Uzfyo6qvFQ2nmffiQx4EgQi6kYRiryn0mbIgnwsNfhXzyLtC1QpsfATLic3wGaP1NOMjOQN/XiYQm4Yk7oklC/dVQ3LypqOlL0YqPXS3eFw=="}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:08.225341 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-796d66f4-2da6-4fc4-8bf5-60a6f8325200 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for project 6b5b284e0b47422592057492601db382. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:57:08.229161 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-796d66f4-2da6-4fc4-8bf5-60a6f8325200 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for user 88efd5eb09064aa2aa89e6d9580c6476 and project 6b5b284e0b47422592057492601db382. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:57:08.290814 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-796d66f4-2da6-4fc4-8bf5-60a6f8325200 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.085159 Aug 24 16:57:08.291397 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 384/762] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Aug 24 16:57:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:10.371161 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-259066564", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4108caa5-f8d0-4511-be15-eaaba4ff32ab"}], "security_groups": [{"name": "tempest-securitygroup--1394585395"}], "key_name": "tempest-keypair-1513236172", "user_data": "}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:10.472012 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.network.neutron [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] validate_networks() for [('4108caa5-f8d0-4511-be15-eaaba4ff32ab', None, None, None, None, None)] {{(pid=127715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:57:10.832838 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Flavor limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:57:10.833319 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Image limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:57:10.833786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Flavor pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:57:10.834196 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Image pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:57:10.834609 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:57:10.843396 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:10.843884 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:10.844322 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:10.845129 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:10.845588 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:10.846018 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:10.863174 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for project 6b5b284e0b47422592057492601db382. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:57:10.867113 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Getting quotas for user 88efd5eb09064aa2aa89e6d9580c6476 and project 6b5b284e0b47422592057492601db382. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:57:10.878057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Going to run 1 instances... {{(pid=127715) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:57:10.880659 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:57:10.998664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-105f9e76-4735-4e79-b5b7-4a41a5d61f17 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.632223 Aug 24 16:57:10.999265 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 379/763] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:57:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:57:11.010717 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cc583d19-7fc6-4039-a4a6-070ec3c828f5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:11.011333 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cc583d19-7fc6-4039-a4a6-070ec3c828f5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:11.065311 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cc583d19-7fc6-4039-a4a6-070ec3c828f5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:11.072218 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cc583d19-7fc6-4039-a4a6-070ec3c828f5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1241 microversion: 2.1 time: 0.065873 Aug 24 16:57:11.073025 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 385/764] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:11 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:11.831655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a80323e5-7fe3-4168-8191-931cc808a9a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:11.832259 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a80323e5-7fe3-4168-8191-931cc808a9a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:11.843789 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a80323e5-7fe3-4168-8191-931cc808a9a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:11.844225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a80323e5-7fe3-4168-8191-931cc808a9a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:11.844699 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a80323e5-7fe3-4168-8191-931cc808a9a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:11.845402 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a80323e5-7fe3-4168-8191-931cc808a9a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:11.845866 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a80323e5-7fe3-4168-8191-931cc808a9a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:11.846302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a80323e5-7fe3-4168-8191-931cc808a9a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:11.869222 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a80323e5-7fe3-4168-8191-931cc808a9a1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/ips" status: 200 len: 151 microversion: 2.20 time: 0.041531 Aug 24 16:57:11.869788 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 380/765] 10.222.0.70 () {60 vars in 1289 bytes} [Wed Aug 24 16:57:11 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:57:12.093408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e106d0f4-e0d8-4f53-9d97-79a9e26a7872 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:12.094121 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e106d0f4-e0d8-4f53-9d97-79a9e26a7872 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:12.101258 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e106d0f4-e0d8-4f53-9d97-79a9e26a7872 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:12.106743 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e106d0f4-e0d8-4f53-9d97-79a9e26a7872 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:12.106743 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e106d0f4-e0d8-4f53-9d97-79a9e26a7872 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:12.106743 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e106d0f4-e0d8-4f53-9d97-79a9e26a7872 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:12.106743 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e106d0f4-e0d8-4f53-9d97-79a9e26a7872 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:12.107444 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e106d0f4-e0d8-4f53-9d97-79a9e26a7872 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:12.174647 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e106d0f4-e0d8-4f53-9d97-79a9e26a7872 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:12.185455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e106d0f4-e0d8-4f53-9d97-79a9e26a7872 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1245 microversion: 2.1 time: 0.093664 Aug 24 16:57:12.185455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 386/766] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:12 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:13.203406 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-333e0f27-eb28-4090-be78-7df9f16a9eaf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:13.204192 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-333e0f27-eb28-4090-be78-7df9f16a9eaf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:13.211210 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-333e0f27-eb28-4090-be78-7df9f16a9eaf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:13.211876 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-333e0f27-eb28-4090-be78-7df9f16a9eaf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:13.212456 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-333e0f27-eb28-4090-be78-7df9f16a9eaf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:13.213756 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-333e0f27-eb28-4090-be78-7df9f16a9eaf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:13.213875 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-333e0f27-eb28-4090-be78-7df9f16a9eaf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:13.214301 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-333e0f27-eb28-4090-be78-7df9f16a9eaf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:13.280792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-333e0f27-eb28-4090-be78-7df9f16a9eaf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:13.288542 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-333e0f27-eb28-4090-be78-7df9f16a9eaf tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1311 microversion: 2.1 time: 0.089294 Aug 24 16:57:13.289143 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 381/767] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:13 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:14.310745 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-34a31c6f-4d77-440e-8107-10f4b6821ece tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:14.311832 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-34a31c6f-4d77-440e-8107-10f4b6821ece tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:14.319272 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-34a31c6f-4d77-440e-8107-10f4b6821ece tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:14.323866 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-34a31c6f-4d77-440e-8107-10f4b6821ece tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:14.323866 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-34a31c6f-4d77-440e-8107-10f4b6821ece tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:14.323866 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-34a31c6f-4d77-440e-8107-10f4b6821ece tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:14.323866 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-34a31c6f-4d77-440e-8107-10f4b6821ece tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:14.324263 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-34a31c6f-4d77-440e-8107-10f4b6821ece tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:14.453589 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-34a31c6f-4d77-440e-8107-10f4b6821ece tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:14.461433 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-34a31c6f-4d77-440e-8107-10f4b6821ece tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1367 microversion: 2.1 time: 0.154809 Aug 24 16:57:14.462002 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 387/768] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:14 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:14.642704 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-04e5e305-da1c-4c5d-b772-f7fa4bcf9924 req-c9364128-1512-4852-a0fa-0f1341d1fbda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0353f35e-4905-47aa-94d0-1332a0615eb0", "tag": "ad61fcba-fcd0-4700-a7fc-4bf7acced400"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:14.654189 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-04e5e305-da1c-4c5d-b772-f7fa4bcf9924 req-c9364128-1512-4852-a0fa-0f1341d1fbda service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:14.654670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-04e5e305-da1c-4c5d-b772-f7fa4bcf9924 req-c9364128-1512-4852-a0fa-0f1341d1fbda service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:14.655102 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-04e5e305-da1c-4c5d-b772-f7fa4bcf9924 req-c9364128-1512-4852-a0fa-0f1341d1fbda service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:14.669736 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-04e5e305-da1c-4c5d-b772-f7fa4bcf9924 req-c9364128-1512-4852-a0fa-0f1341d1fbda service nova] Creating event network-changed:ad61fcba-fcd0-4700-a7fc-4bf7acced400 for instance 0353f35e-4905-47aa-94d0-1332a0615eb0 on hv-cinder-85220 Aug 24 16:57:14.672847 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-04e5e305-da1c-4c5d-b772-f7fa4bcf9924 req-c9364128-1512-4852-a0fa-0f1341d1fbda service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033978 Aug 24 16:57:14.673607 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 382/769] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:15.011161 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-43458022-f06b-4d5c-8124-f04f3ac9e678 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:15.011616 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-43458022-f06b-4d5c-8124-f04f3ac9e678 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:15.017566 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43458022-f06b-4d5c-8124-f04f3ac9e678 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:15.018045 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43458022-f06b-4d5c-8124-f04f3ac9e678 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:15.018480 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43458022-f06b-4d5c-8124-f04f3ac9e678 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:15.019163 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43458022-f06b-4d5c-8124-f04f3ac9e678 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:15.020264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43458022-f06b-4d5c-8124-f04f3ac9e678 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:15.020717 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43458022-f06b-4d5c-8124-f04f3ac9e678 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:15.042615 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-43458022-f06b-4d5c-8124-f04f3ac9e678 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lazy-loading 'flavor' on Instance uuid 09d1714b-1531-428f-a205-e42cedf76d9b {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:57:15.484937 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c1abebb0-3d85-4ebe-8e43-c035fd32ae4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:15.485914 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c1abebb0-3d85-4ebe-8e43-c035fd32ae4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:15.493878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c1abebb0-3d85-4ebe-8e43-c035fd32ae4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:15.494379 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c1abebb0-3d85-4ebe-8e43-c035fd32ae4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:15.494820 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c1abebb0-3d85-4ebe-8e43-c035fd32ae4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:15.495533 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c1abebb0-3d85-4ebe-8e43-c035fd32ae4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:15.495987 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c1abebb0-3d85-4ebe-8e43-c035fd32ae4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:15.496439 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c1abebb0-3d85-4ebe-8e43-c035fd32ae4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:15.597242 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-43458022-f06b-4d5c-8124-f04f3ac9e678 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "POST /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/action" status: 202 len: 0 microversion: 2.20 time: 0.589832 Aug 24 16:57:15.601875 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 388/770] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Aug 24 16:57:15 2022] POST /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:15.606870 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ac855717-f6b2-46ca-9bc7-7b44540db364 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:15.607583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ac855717-f6b2-46ca-9bc7-7b44540db364 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:15.619496 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac855717-f6b2-46ca-9bc7-7b44540db364 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:15.619994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac855717-f6b2-46ca-9bc7-7b44540db364 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:15.620465 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac855717-f6b2-46ca-9bc7-7b44540db364 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:15.621280 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac855717-f6b2-46ca-9bc7-7b44540db364 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:15.621741 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac855717-f6b2-46ca-9bc7-7b44540db364 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:15.622171 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac855717-f6b2-46ca-9bc7-7b44540db364 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:15.715805 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c1abebb0-3d85-4ebe-8e43-c035fd32ae4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:15.725151 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c1abebb0-3d85-4ebe-8e43-c035fd32ae4b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1367 microversion: 2.1 time: 0.245558 Aug 24 16:57:15.738670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 383/771] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:15 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:57:15.793858 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ac855717-f6b2-46ca-9bc7-7b44540db364 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:15.802699 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ac855717-f6b2-46ca-9bc7-7b44540db364 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:15.804372 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ac855717-f6b2-46ca-9bc7-7b44540db364 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:15.805557 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ac855717-f6b2-46ca-9bc7-7b44540db364 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.203028 Aug 24 16:57:15.806110 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 389/772] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:15 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:57:16.746409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c9dd0949-c3e8-4c0e-b849-1086e6f7bf8f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:16.747030 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c9dd0949-c3e8-4c0e-b849-1086e6f7bf8f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:16.753401 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c9dd0949-c3e8-4c0e-b849-1086e6f7bf8f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:16.754387 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c9dd0949-c3e8-4c0e-b849-1086e6f7bf8f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:16.755078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c9dd0949-c3e8-4c0e-b849-1086e6f7bf8f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:16.755769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c9dd0949-c3e8-4c0e-b849-1086e6f7bf8f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:16.756240 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c9dd0949-c3e8-4c0e-b849-1086e6f7bf8f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:16.756692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c9dd0949-c3e8-4c0e-b849-1086e6f7bf8f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:16.829439 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7ee63372-47eb-4dd3-b5d9-3e4348836260 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:16.830007 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7ee63372-47eb-4dd3-b5d9-3e4348836260 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:16.836437 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ee63372-47eb-4dd3-b5d9-3e4348836260 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:16.836937 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ee63372-47eb-4dd3-b5d9-3e4348836260 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:16.837377 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ee63372-47eb-4dd3-b5d9-3e4348836260 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:16.838071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ee63372-47eb-4dd3-b5d9-3e4348836260 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:16.838525 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ee63372-47eb-4dd3-b5d9-3e4348836260 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:16.838948 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ee63372-47eb-4dd3-b5d9-3e4348836260 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:16.894106 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c9dd0949-c3e8-4c0e-b849-1086e6f7bf8f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:16.901791 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c9dd0949-c3e8-4c0e-b849-1086e6f7bf8f tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1367 microversion: 2.1 time: 0.159203 Aug 24 16:57:16.902356 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 384/773] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:16 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:16.978328 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7ee63372-47eb-4dd3-b5d9-3e4348836260 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:16.986487 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7ee63372-47eb-4dd3-b5d9-3e4348836260 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:16.988564 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7ee63372-47eb-4dd3-b5d9-3e4348836260 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:16.989780 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7ee63372-47eb-4dd3-b5d9-3e4348836260 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.164356 Aug 24 16:57:16.990337 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 390/774] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:16 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:57:17.922644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ec4e0941-a267-4116-9cac-b19e3e55bb37 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:17.923261 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ec4e0941-a267-4116-9cac-b19e3e55bb37 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:17.930235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec4e0941-a267-4116-9cac-b19e3e55bb37 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:17.930724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec4e0941-a267-4116-9cac-b19e3e55bb37 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:17.931164 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec4e0941-a267-4116-9cac-b19e3e55bb37 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:17.931858 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec4e0941-a267-4116-9cac-b19e3e55bb37 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:17.932317 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec4e0941-a267-4116-9cac-b19e3e55bb37 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:17.932776 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec4e0941-a267-4116-9cac-b19e3e55bb37 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:18.013362 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4b8879a0-26fe-4577-aef7-a5d995d8c941 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:18.014035 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4b8879a0-26fe-4577-aef7-a5d995d8c941 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:18.020420 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b8879a0-26fe-4577-aef7-a5d995d8c941 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:18.020975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b8879a0-26fe-4577-aef7-a5d995d8c941 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:18.021441 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b8879a0-26fe-4577-aef7-a5d995d8c941 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:18.022131 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b8879a0-26fe-4577-aef7-a5d995d8c941 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:18.022582 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b8879a0-26fe-4577-aef7-a5d995d8c941 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:18.023000 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b8879a0-26fe-4577-aef7-a5d995d8c941 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:18.027222 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:18.062464 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ec4e0941-a267-4116-9cac-b19e3e55bb37 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:18.070261 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ec4e0941-a267-4116-9cac-b19e3e55bb37 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1367 microversion: 2.1 time: 0.151487 Aug 24 16:57:18.070833 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 385/775] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:17 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:18.381880 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4b8879a0-26fe-4577-aef7-a5d995d8c941 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:18.390023 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4b8879a0-26fe-4577-aef7-a5d995d8c941 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:18.391504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4b8879a0-26fe-4577-aef7-a5d995d8c941 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:18.392684 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4b8879a0-26fe-4577-aef7-a5d995d8c941 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.383310 Aug 24 16:57:18.393241 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 391/776] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:18 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:57:19.090204 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6939f4c2-455d-4939-9f66-9b74a59aef84 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:19.090905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6939f4c2-455d-4939-9f66-9b74a59aef84 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:19.098002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6939f4c2-455d-4939-9f66-9b74a59aef84 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:19.098502 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6939f4c2-455d-4939-9f66-9b74a59aef84 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:19.098947 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6939f4c2-455d-4939-9f66-9b74a59aef84 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:19.099644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6939f4c2-455d-4939-9f66-9b74a59aef84 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:19.100104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6939f4c2-455d-4939-9f66-9b74a59aef84 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:19.100563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6939f4c2-455d-4939-9f66-9b74a59aef84 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:19.229396 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6939f4c2-455d-4939-9f66-9b74a59aef84 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:19.236952 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6939f4c2-455d-4939-9f66-9b74a59aef84 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1367 microversion: 2.1 time: 0.150634 Aug 24 16:57:19.237519 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 386/777] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:19 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:19.416779 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f85d5e33-9e41-4142-b169-0e53e90c4a01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:19.417459 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f85d5e33-9e41-4142-b169-0e53e90c4a01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:19.424050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f85d5e33-9e41-4142-b169-0e53e90c4a01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:19.424627 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f85d5e33-9e41-4142-b169-0e53e90c4a01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:19.425062 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f85d5e33-9e41-4142-b169-0e53e90c4a01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:19.426307 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f85d5e33-9e41-4142-b169-0e53e90c4a01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:19.426761 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f85d5e33-9e41-4142-b169-0e53e90c4a01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:19.427180 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f85d5e33-9e41-4142-b169-0e53e90c4a01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:19.564321 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f85d5e33-9e41-4142-b169-0e53e90c4a01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:19.573114 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f85d5e33-9e41-4142-b169-0e53e90c4a01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:19.574707 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f85d5e33-9e41-4142-b169-0e53e90c4a01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:19.575951 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f85d5e33-9e41-4142-b169-0e53e90c4a01 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.163793 Aug 24 16:57:19.577105 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 392/778] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:19 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:20.258335 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3c131e3b-111e-45f2-9618-39eddade14ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:20.258949 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3c131e3b-111e-45f2-9618-39eddade14ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:20.265205 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3c131e3b-111e-45f2-9618-39eddade14ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:20.265692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3c131e3b-111e-45f2-9618-39eddade14ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:20.266133 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3c131e3b-111e-45f2-9618-39eddade14ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:20.266823 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3c131e3b-111e-45f2-9618-39eddade14ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:20.267275 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3c131e3b-111e-45f2-9618-39eddade14ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:20.267698 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3c131e3b-111e-45f2-9618-39eddade14ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:20.396776 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3c131e3b-111e-45f2-9618-39eddade14ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:20.404567 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3c131e3b-111e-45f2-9618-39eddade14ed tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1367 microversion: 2.1 time: 0.150878 Aug 24 16:57:20.405140 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 387/779] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:20 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:20.598226 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-771a7a0f-9b92-41ba-9ed4-5fb312a3c649 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:20.598916 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-771a7a0f-9b92-41ba-9ed4-5fb312a3c649 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:20.601253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:20.606009 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-771a7a0f-9b92-41ba-9ed4-5fb312a3c649 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:20.606494 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-771a7a0f-9b92-41ba-9ed4-5fb312a3c649 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:20.610561 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-771a7a0f-9b92-41ba-9ed4-5fb312a3c649 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:20.610561 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-771a7a0f-9b92-41ba-9ed4-5fb312a3c649 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:20.610561 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-771a7a0f-9b92-41ba-9ed4-5fb312a3c649 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:20.610561 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-771a7a0f-9b92-41ba-9ed4-5fb312a3c649 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:20.737624 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-771a7a0f-9b92-41ba-9ed4-5fb312a3c649 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:20.746270 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-771a7a0f-9b92-41ba-9ed4-5fb312a3c649 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:20.747774 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-771a7a0f-9b92-41ba-9ed4-5fb312a3c649 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:20.748985 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-771a7a0f-9b92-41ba-9ed4-5fb312a3c649 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.155210 Aug 24 16:57:20.749540 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 393/780] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:20 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:21.426052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-08e2d09b-fbef-4bc8-9d8e-aa82a6f06227 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:21.426693 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-08e2d09b-fbef-4bc8-9d8e-aa82a6f06227 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:21.428686 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:21.435459 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=6 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:21.435459 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08e2d09b-fbef-4bc8-9d8e-aa82a6f06227 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:21.435459 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08e2d09b-fbef-4bc8-9d8e-aa82a6f06227 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:21.435459 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08e2d09b-fbef-4bc8-9d8e-aa82a6f06227 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:21.435885 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08e2d09b-fbef-4bc8-9d8e-aa82a6f06227 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:21.436148 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08e2d09b-fbef-4bc8-9d8e-aa82a6f06227 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:21.436624 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-08e2d09b-fbef-4bc8-9d8e-aa82a6f06227 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:21.569888 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-08e2d09b-fbef-4bc8-9d8e-aa82a6f06227 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:21.577707 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-08e2d09b-fbef-4bc8-9d8e-aa82a6f06227 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1367 microversion: 2.1 time: 0.156173 Aug 24 16:57:21.578275 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 388/781] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:21 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:21.677890 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-a44057a4-6127-452a-a4cf-e2ab46ced853 req-3a118cd0-6769-4f07-923d-ddd1c437aa8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0353f35e-4905-47aa-94d0-1332a0615eb0", "name": "network-vif-plugged", "status": "completed", "tag": "ad61fcba-fcd0-4700-a7fc-4bf7acced400"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:21.683440 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=6 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:21.689709 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-a44057a4-6127-452a-a4cf-e2ab46ced853 req-3a118cd0-6769-4f07-923d-ddd1c437aa8e service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:21.690257 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-a44057a4-6127-452a-a4cf-e2ab46ced853 req-3a118cd0-6769-4f07-923d-ddd1c437aa8e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:21.690756 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-a44057a4-6127-452a-a4cf-e2ab46ced853 req-3a118cd0-6769-4f07-923d-ddd1c437aa8e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:21.703338 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-a44057a4-6127-452a-a4cf-e2ab46ced853 req-3a118cd0-6769-4f07-923d-ddd1c437aa8e service nova] Creating event network-vif-plugged:ad61fcba-fcd0-4700-a7fc-4bf7acced400 for instance 0353f35e-4905-47aa-94d0-1332a0615eb0 on hv-cinder-85220 Aug 24 16:57:21.707887 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-a44057a4-6127-452a-a4cf-e2ab46ced853 req-3a118cd0-6769-4f07-923d-ddd1c437aa8e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034301 Aug 24 16:57:21.708504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 394/782] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:21.772487 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b8834e44-1c70-480e-b28b-61935f917d96 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:21.904871 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b8834e44-1c70-480e-b28b-61935f917d96 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:21.904871 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b8834e44-1c70-480e-b28b-61935f917d96 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:21.904871 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b8834e44-1c70-480e-b28b-61935f917d96 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:21.904871 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b8834e44-1c70-480e-b28b-61935f917d96 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:21.905609 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b8834e44-1c70-480e-b28b-61935f917d96 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:21.905609 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b8834e44-1c70-480e-b28b-61935f917d96 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:21.905609 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b8834e44-1c70-480e-b28b-61935f917d96 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:21.935206 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b8834e44-1c70-480e-b28b-61935f917d96 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:21.940923 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b8834e44-1c70-480e-b28b-61935f917d96 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:21.942935 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b8834e44-1c70-480e-b28b-61935f917d96 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:21.944094 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b8834e44-1c70-480e-b28b-61935f917d96 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.176603 Aug 24 16:57:21.944714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 389/783] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:21 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:22.600882 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-afc556b5-d394-42c2-b0bd-b898e0bdd3e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:22.601679 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-afc556b5-d394-42c2-b0bd-b898e0bdd3e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:22.608895 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc556b5-d394-42c2-b0bd-b898e0bdd3e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:22.621131 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc556b5-d394-42c2-b0bd-b898e0bdd3e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:22.621131 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc556b5-d394-42c2-b0bd-b898e0bdd3e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:22.621131 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc556b5-d394-42c2-b0bd-b898e0bdd3e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:22.621131 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc556b5-d394-42c2-b0bd-b898e0bdd3e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:22.621590 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc556b5-d394-42c2-b0bd-b898e0bdd3e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:22.747373 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-afc556b5-d394-42c2-b0bd-b898e0bdd3e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:22.755751 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-afc556b5-d394-42c2-b0bd-b898e0bdd3e1 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1367 microversion: 2.1 time: 0.160728 Aug 24 16:57:22.756393 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 395/784] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:22 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:22.967927 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5038d791-2b37-468d-88ba-bec8dd0f8a3b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:22.968631 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5038d791-2b37-468d-88ba-bec8dd0f8a3b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:22.975762 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5038d791-2b37-468d-88ba-bec8dd0f8a3b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:22.976248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5038d791-2b37-468d-88ba-bec8dd0f8a3b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:22.976721 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5038d791-2b37-468d-88ba-bec8dd0f8a3b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:22.977427 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5038d791-2b37-468d-88ba-bec8dd0f8a3b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:22.977888 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5038d791-2b37-468d-88ba-bec8dd0f8a3b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:22.978361 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5038d791-2b37-468d-88ba-bec8dd0f8a3b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:22.997329 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:23.112503 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-5038d791-2b37-468d-88ba-bec8dd0f8a3b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:23.120544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-5038d791-2b37-468d-88ba-bec8dd0f8a3b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:23.122080 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-5038d791-2b37-468d-88ba-bec8dd0f8a3b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:23.123248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5038d791-2b37-468d-88ba-bec8dd0f8a3b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.159332 Aug 24 16:57:23.123811 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 390/785] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:22 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:23.777053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3881163b-73bb-4b54-a868-96392f6d4633 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:23.777587 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3881163b-73bb-4b54-a868-96392f6d4633 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:23.783967 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3881163b-73bb-4b54-a868-96392f6d4633 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:23.784480 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3881163b-73bb-4b54-a868-96392f6d4633 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:23.784927 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3881163b-73bb-4b54-a868-96392f6d4633 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:23.785618 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3881163b-73bb-4b54-a868-96392f6d4633 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:23.786727 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3881163b-73bb-4b54-a868-96392f6d4633 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:23.787155 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3881163b-73bb-4b54-a868-96392f6d4633 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:23.918120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3881163b-73bb-4b54-a868-96392f6d4633 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:23.925830 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3881163b-73bb-4b54-a868-96392f6d4633 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1367 microversion: 2.1 time: 0.152772 Aug 24 16:57:23.926400 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 396/786] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:23 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:24.146344 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-26be6011-027d-4afe-beab-d8d301cc2c40 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:24.146938 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-26be6011-027d-4afe-beab-d8d301cc2c40 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:24.153249 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-26be6011-027d-4afe-beab-d8d301cc2c40 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:24.153725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-26be6011-027d-4afe-beab-d8d301cc2c40 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:24.154154 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-26be6011-027d-4afe-beab-d8d301cc2c40 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:24.154832 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-26be6011-027d-4afe-beab-d8d301cc2c40 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:24.155280 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-26be6011-027d-4afe-beab-d8d301cc2c40 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:24.155700 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-26be6011-027d-4afe-beab-d8d301cc2c40 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:24.281841 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-26be6011-027d-4afe-beab-d8d301cc2c40 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:24.290178 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-26be6011-027d-4afe-beab-d8d301cc2c40 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:24.291675 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-26be6011-027d-4afe-beab-d8d301cc2c40 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:24.292899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-26be6011-027d-4afe-beab-d8d301cc2c40 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.151495 Aug 24 16:57:24.293482 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 391/787] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:24 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:24.371299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1032646006", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:24.421615 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] validate_networks() for None {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:57:24.704703 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:57:24.705135 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:57:24.705654 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:57:24.706062 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:57:24.706477 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:57:24.715251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:24.715739 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:24.716176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:24.716947 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:24.717401 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:24.717828 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:24.734650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Getting quotas for project 9ebba8d99c8847ddb971578fb19cd6e2. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:57:24.738569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Getting quotas for user 2c77c2b9101541da83f67b69990fa205 and project 9ebba8d99c8847ddb971578fb19cd6e2. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:57:24.749838 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:57:24.752066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:57:24.913579 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0e07fbdf-543e-415c-9255-efc35515aa83 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546040 Aug 24 16:57:24.916871 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 397/788] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:57:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:57:24.925029 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b955fdeb-46bc-4e60-a960-94f8bc7c4134 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:24.925586 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b955fdeb-46bc-4e60-a960-94f8bc7c4134 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:24.947179 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ec71fd0d-505b-4202-8a2c-c4a9823fc1ec tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:24.947861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ec71fd0d-505b-4202-8a2c-c4a9823fc1ec tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:24.957758 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec71fd0d-505b-4202-8a2c-c4a9823fc1ec tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:24.960279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec71fd0d-505b-4202-8a2c-c4a9823fc1ec tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:24.960279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec71fd0d-505b-4202-8a2c-c4a9823fc1ec tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:24.960279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec71fd0d-505b-4202-8a2c-c4a9823fc1ec tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:24.960279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec71fd0d-505b-4202-8a2c-c4a9823fc1ec tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:24.960684 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec71fd0d-505b-4202-8a2c-c4a9823fc1ec tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:24.982018 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b955fdeb-46bc-4e60-a960-94f8bc7c4134 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:24.989622 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b955fdeb-46bc-4e60-a960-94f8bc7c4134 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1215 microversion: 2.1 time: 0.067951 Aug 24 16:57:24.990506 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 392/789] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:24 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:25.098048 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ec71fd0d-505b-4202-8a2c-c4a9823fc1ec tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:25.106474 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ec71fd0d-505b-4202-8a2c-c4a9823fc1ec tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1557 microversion: 2.1 time: 0.164202 Aug 24 16:57:25.107037 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 398/790] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:24 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1557 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:25.126495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b72fa8f0-946f-4530-a9f9-65385bb4007a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:25.126996 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b72fa8f0-946f-4530-a9f9-65385bb4007a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:25.133213 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b72fa8f0-946f-4530-a9f9-65385bb4007a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:25.133701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b72fa8f0-946f-4530-a9f9-65385bb4007a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:25.134141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b72fa8f0-946f-4530-a9f9-65385bb4007a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:25.134867 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b72fa8f0-946f-4530-a9f9-65385bb4007a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:25.135324 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b72fa8f0-946f-4530-a9f9-65385bb4007a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:25.135752 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b72fa8f0-946f-4530-a9f9-65385bb4007a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:25.212811 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b72fa8f0-946f-4530-a9f9-65385bb4007a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090160 Aug 24 16:57:25.213414 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 393/791] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Aug 24 16:57:25 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:25.316582 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-de71c95d-b8ab-489b-9433-9a86929b437e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:25.317747 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-de71c95d-b8ab-489b-9433-9a86929b437e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:25.323734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-de71c95d-b8ab-489b-9433-9a86929b437e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:25.324209 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-de71c95d-b8ab-489b-9433-9a86929b437e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:25.324662 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-de71c95d-b8ab-489b-9433-9a86929b437e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:25.325344 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-de71c95d-b8ab-489b-9433-9a86929b437e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:25.325790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-de71c95d-b8ab-489b-9433-9a86929b437e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:25.326206 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-de71c95d-b8ab-489b-9433-9a86929b437e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:25.459996 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-de71c95d-b8ab-489b-9433-9a86929b437e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:25.471140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-de71c95d-b8ab-489b-9433-9a86929b437e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:25.472980 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-de71c95d-b8ab-489b-9433-9a86929b437e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:25.476554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-de71c95d-b8ab-489b-9433-9a86929b437e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.162472 Aug 24 16:57:25.476554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 399/792] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:25 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:26.010295 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b7d0198e-21f1-4579-bf28-71c1810fd78a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:26.011024 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b7d0198e-21f1-4579-bf28-71c1810fd78a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:26.019443 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7d0198e-21f1-4579-bf28-71c1810fd78a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:26.019869 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7d0198e-21f1-4579-bf28-71c1810fd78a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:26.020311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7d0198e-21f1-4579-bf28-71c1810fd78a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:26.021579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7d0198e-21f1-4579-bf28-71c1810fd78a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:26.022053 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7d0198e-21f1-4579-bf28-71c1810fd78a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:26.022572 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7d0198e-21f1-4579-bf28-71c1810fd78a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:26.085134 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b7d0198e-21f1-4579-bf28-71c1810fd78a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:26.092974 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b7d0198e-21f1-4579-bf28-71c1810fd78a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1219 microversion: 2.1 time: 0.086626 Aug 24 16:57:26.100674 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 394/793] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:26 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:26.231263 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-f04491b2-5c03-4164-b728-6b476c21cd60 req-6923ff18-267e-47e9-8641-c725591f78a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0353f35e-4905-47aa-94d0-1332a0615eb0", "tag": "ad61fcba-fcd0-4700-a7fc-4bf7acced400"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:26.241136 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-f04491b2-5c03-4164-b728-6b476c21cd60 req-6923ff18-267e-47e9-8641-c725591f78a9 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:26.241611 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-f04491b2-5c03-4164-b728-6b476c21cd60 req-6923ff18-267e-47e9-8641-c725591f78a9 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:26.242044 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-f04491b2-5c03-4164-b728-6b476c21cd60 req-6923ff18-267e-47e9-8641-c725591f78a9 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:26.253279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-f04491b2-5c03-4164-b728-6b476c21cd60 req-6923ff18-267e-47e9-8641-c725591f78a9 service nova] Creating event network-changed:ad61fcba-fcd0-4700-a7fc-4bf7acced400 for instance 0353f35e-4905-47aa-94d0-1332a0615eb0 on hv-cinder-85220 Aug 24 16:57:26.258920 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-f04491b2-5c03-4164-b728-6b476c21cd60 req-6923ff18-267e-47e9-8641-c725591f78a9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031260 Aug 24 16:57:26.259519 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 400/794] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:26.498566 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0cc96815-b9fd-407c-8ccf-75406c9dfeb1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:26.499998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0cc96815-b9fd-407c-8ccf-75406c9dfeb1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:26.509225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0cc96815-b9fd-407c-8ccf-75406c9dfeb1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:26.512928 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0cc96815-b9fd-407c-8ccf-75406c9dfeb1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:26.512928 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0cc96815-b9fd-407c-8ccf-75406c9dfeb1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:26.512928 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0cc96815-b9fd-407c-8ccf-75406c9dfeb1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:26.512928 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0cc96815-b9fd-407c-8ccf-75406c9dfeb1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:26.513318 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0cc96815-b9fd-407c-8ccf-75406c9dfeb1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:26.673064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0cc96815-b9fd-407c-8ccf-75406c9dfeb1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:26.682829 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0cc96815-b9fd-407c-8ccf-75406c9dfeb1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:26.694497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0cc96815-b9fd-407c-8ccf-75406c9dfeb1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:26.694497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0cc96815-b9fd-407c-8ccf-75406c9dfeb1 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.191418 Aug 24 16:57:26.694497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 395/795] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:26 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:27.116077 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7cbeeb1f-0f0e-4d20-b748-79d64b7e00f3 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:27.116183 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7cbeeb1f-0f0e-4d20-b748-79d64b7e00f3 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:27.131337 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cbeeb1f-0f0e-4d20-b748-79d64b7e00f3 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:27.131986 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cbeeb1f-0f0e-4d20-b748-79d64b7e00f3 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:27.132634 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cbeeb1f-0f0e-4d20-b748-79d64b7e00f3 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:27.133354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cbeeb1f-0f0e-4d20-b748-79d64b7e00f3 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:27.133810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cbeeb1f-0f0e-4d20-b748-79d64b7e00f3 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:27.134237 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cbeeb1f-0f0e-4d20-b748-79d64b7e00f3 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:27.202913 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7cbeeb1f-0f0e-4d20-b748-79d64b7e00f3 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:27.211840 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7cbeeb1f-0f0e-4d20-b748-79d64b7e00f3 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1267 microversion: 2.1 time: 0.101303 Aug 24 16:57:27.212439 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 401/796] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:27 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:27.708299 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-07adb638-7dd5-4d35-8989-4cde3480dc9c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:27.709533 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-07adb638-7dd5-4d35-8989-4cde3480dc9c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:27.715884 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-07adb638-7dd5-4d35-8989-4cde3480dc9c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:27.716515 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-07adb638-7dd5-4d35-8989-4cde3480dc9c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:27.716968 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-07adb638-7dd5-4d35-8989-4cde3480dc9c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:27.717660 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-07adb638-7dd5-4d35-8989-4cde3480dc9c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:27.718118 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-07adb638-7dd5-4d35-8989-4cde3480dc9c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:27.718544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-07adb638-7dd5-4d35-8989-4cde3480dc9c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:27.849084 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-07adb638-7dd5-4d35-8989-4cde3480dc9c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:27.858107 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-07adb638-7dd5-4d35-8989-4cde3480dc9c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:27.859759 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-07adb638-7dd5-4d35-8989-4cde3480dc9c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:27.861052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-07adb638-7dd5-4d35-8989-4cde3480dc9c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.156683 Aug 24 16:57:27.861698 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 396/797] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:27 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:28.233117 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a78508e6-bd6a-4c7e-857d-71a1b3ae5284 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:28.234365 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a78508e6-bd6a-4c7e-857d-71a1b3ae5284 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:28.242336 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a78508e6-bd6a-4c7e-857d-71a1b3ae5284 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:28.242823 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a78508e6-bd6a-4c7e-857d-71a1b3ae5284 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:28.243277 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a78508e6-bd6a-4c7e-857d-71a1b3ae5284 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:28.243962 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a78508e6-bd6a-4c7e-857d-71a1b3ae5284 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:28.244427 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a78508e6-bd6a-4c7e-857d-71a1b3ae5284 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:28.245047 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a78508e6-bd6a-4c7e-857d-71a1b3ae5284 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:28.392369 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a78508e6-bd6a-4c7e-857d-71a1b3ae5284 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:28.400236 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a78508e6-bd6a-4c7e-857d-71a1b3ae5284 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1315 microversion: 2.1 time: 0.171054 Aug 24 16:57:28.400900 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 402/798] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:28 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:28.883520 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8a4a76cb-8b83-4b17-a4a8-c6b6770de645 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:28.884249 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8a4a76cb-8b83-4b17-a4a8-c6b6770de645 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:28.890934 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a4a76cb-8b83-4b17-a4a8-c6b6770de645 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:28.891427 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a4a76cb-8b83-4b17-a4a8-c6b6770de645 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:28.891861 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a4a76cb-8b83-4b17-a4a8-c6b6770de645 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:28.892629 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a4a76cb-8b83-4b17-a4a8-c6b6770de645 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:28.893127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a4a76cb-8b83-4b17-a4a8-c6b6770de645 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:28.893481 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8a4a76cb-8b83-4b17-a4a8-c6b6770de645 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:29.027132 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8a4a76cb-8b83-4b17-a4a8-c6b6770de645 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:29.035307 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8a4a76cb-8b83-4b17-a4a8-c6b6770de645 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:29.037484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8a4a76cb-8b83-4b17-a4a8-c6b6770de645 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:29.038650 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8a4a76cb-8b83-4b17-a4a8-c6b6770de645 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.159438 Aug 24 16:57:29.039214 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 397/799] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:28 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:29.076665 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-83db7dae-cef3-41e6-8dd8-d82ed54947d0 req-c3b36a60-d669-4e9d-9628-84f6dda52d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeb67c2a-9f17-4898-9f29-ad435aab9781", "tag": "0986ce52-2371-4aff-8130-e230b0c37601"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:29.086956 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-83db7dae-cef3-41e6-8dd8-d82ed54947d0 req-c3b36a60-d669-4e9d-9628-84f6dda52d10 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:29.087366 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-83db7dae-cef3-41e6-8dd8-d82ed54947d0 req-c3b36a60-d669-4e9d-9628-84f6dda52d10 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:29.087797 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-83db7dae-cef3-41e6-8dd8-d82ed54947d0 req-c3b36a60-d669-4e9d-9628-84f6dda52d10 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:29.098536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-83db7dae-cef3-41e6-8dd8-d82ed54947d0 req-c3b36a60-d669-4e9d-9628-84f6dda52d10 service nova] Creating event network-changed:0986ce52-2371-4aff-8130-e230b0c37601 for instance aeb67c2a-9f17-4898-9f29-ad435aab9781 on hv-cinder-85220 Aug 24 16:57:29.103932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-83db7dae-cef3-41e6-8dd8-d82ed54947d0 req-c3b36a60-d669-4e9d-9628-84f6dda52d10 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031109 Aug 24 16:57:29.104543 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 403/800] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:29.426313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-48ef5d68-f5e1-4f12-8b47-15d5ca06de17 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:29.434718 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-48ef5d68-f5e1-4f12-8b47-15d5ca06de17 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:29.434718 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-48ef5d68-f5e1-4f12-8b47-15d5ca06de17 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:29.434718 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-48ef5d68-f5e1-4f12-8b47-15d5ca06de17 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:29.434718 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-48ef5d68-f5e1-4f12-8b47-15d5ca06de17 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:29.435175 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-48ef5d68-f5e1-4f12-8b47-15d5ca06de17 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:29.435175 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-48ef5d68-f5e1-4f12-8b47-15d5ca06de17 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:29.435360 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-48ef5d68-f5e1-4f12-8b47-15d5ca06de17 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:29.567731 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-48ef5d68-f5e1-4f12-8b47-15d5ca06de17 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:29.576052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-48ef5d68-f5e1-4f12-8b47-15d5ca06de17 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1315 microversion: 2.1 time: 0.153525 Aug 24 16:57:29.576651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 398/801] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:29 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:30.066075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-85a6b228-afdb-4d50-9854-593a670e5c80 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:30.066678 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-85a6b228-afdb-4d50-9854-593a670e5c80 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:30.073437 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85a6b228-afdb-4d50-9854-593a670e5c80 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:30.073922 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85a6b228-afdb-4d50-9854-593a670e5c80 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:30.074358 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85a6b228-afdb-4d50-9854-593a670e5c80 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:30.075059 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85a6b228-afdb-4d50-9854-593a670e5c80 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:30.075512 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85a6b228-afdb-4d50-9854-593a670e5c80 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:30.075933 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85a6b228-afdb-4d50-9854-593a670e5c80 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:30.206493 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-85a6b228-afdb-4d50-9854-593a670e5c80 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:30.215124 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-85a6b228-afdb-4d50-9854-593a670e5c80 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:30.216657 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-85a6b228-afdb-4d50-9854-593a670e5c80 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:30.217815 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-85a6b228-afdb-4d50-9854-593a670e5c80 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.156592 Aug 24 16:57:30.218370 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 404/802] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:30 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:30.596958 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-397200f9-b7c7-441a-b35e-d5998f9c906a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:30.597568 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-397200f9-b7c7-441a-b35e-d5998f9c906a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:30.599834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:30.605045 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-397200f9-b7c7-441a-b35e-d5998f9c906a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:30.605532 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-397200f9-b7c7-441a-b35e-d5998f9c906a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:30.605972 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-397200f9-b7c7-441a-b35e-d5998f9c906a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:30.606658 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-397200f9-b7c7-441a-b35e-d5998f9c906a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:30.607112 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-397200f9-b7c7-441a-b35e-d5998f9c906a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:30.607534 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-397200f9-b7c7-441a-b35e-d5998f9c906a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:30.734652 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-397200f9-b7c7-441a-b35e-d5998f9c906a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:30.742721 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-397200f9-b7c7-441a-b35e-d5998f9c906a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1315 microversion: 2.1 time: 0.149007 Aug 24 16:57:30.743287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 399/803] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:30 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:31.240344 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-82735bb4-aeff-4ebf-ab3b-248ad3438c09 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:31.240973 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-82735bb4-aeff-4ebf-ab3b-248ad3438c09 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:31.247841 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82735bb4-aeff-4ebf-ab3b-248ad3438c09 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:31.248324 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82735bb4-aeff-4ebf-ab3b-248ad3438c09 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:31.248796 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82735bb4-aeff-4ebf-ab3b-248ad3438c09 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:31.249488 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82735bb4-aeff-4ebf-ab3b-248ad3438c09 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:31.249943 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82735bb4-aeff-4ebf-ab3b-248ad3438c09 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:31.250367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82735bb4-aeff-4ebf-ab3b-248ad3438c09 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:31.378755 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-82735bb4-aeff-4ebf-ab3b-248ad3438c09 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:31.387067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-82735bb4-aeff-4ebf-ab3b-248ad3438c09 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:31.388579 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-82735bb4-aeff-4ebf-ab3b-248ad3438c09 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:31.389723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-82735bb4-aeff-4ebf-ab3b-248ad3438c09 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.153262 Aug 24 16:57:31.390272 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 405/804] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:31 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:31.764122 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e8d182fe-c42a-488b-8b71-d8243930d658 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:31.764770 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e8d182fe-c42a-488b-8b71-d8243930d658 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:31.771107 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e8d182fe-c42a-488b-8b71-d8243930d658 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:31.771587 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e8d182fe-c42a-488b-8b71-d8243930d658 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:31.772022 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e8d182fe-c42a-488b-8b71-d8243930d658 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:31.772724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e8d182fe-c42a-488b-8b71-d8243930d658 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:31.773202 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e8d182fe-c42a-488b-8b71-d8243930d658 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:31.773658 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e8d182fe-c42a-488b-8b71-d8243930d658 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:31.903347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e8d182fe-c42a-488b-8b71-d8243930d658 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:31.910887 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e8d182fe-c42a-488b-8b71-d8243930d658 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1315 microversion: 2.1 time: 0.150568 Aug 24 16:57:31.911451 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 400/805] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:31 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:32.412965 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-db7654ab-e6d1-4fed-abeb-94f54528c22c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:32.414122 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-db7654ab-e6d1-4fed-abeb-94f54528c22c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:32.420607 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db7654ab-e6d1-4fed-abeb-94f54528c22c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:32.422954 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db7654ab-e6d1-4fed-abeb-94f54528c22c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:32.422954 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db7654ab-e6d1-4fed-abeb-94f54528c22c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:32.422954 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db7654ab-e6d1-4fed-abeb-94f54528c22c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:32.422954 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db7654ab-e6d1-4fed-abeb-94f54528c22c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:32.423333 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db7654ab-e6d1-4fed-abeb-94f54528c22c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:32.549845 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-db7654ab-e6d1-4fed-abeb-94f54528c22c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:32.558127 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-db7654ab-e6d1-4fed-abeb-94f54528c22c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:32.559608 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-db7654ab-e6d1-4fed-abeb-94f54528c22c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:32.560785 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-db7654ab-e6d1-4fed-abeb-94f54528c22c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.151957 Aug 24 16:57:32.561442 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 406/806] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:32 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:32.932332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-cc0a2681-3ffc-44e7-b3c4-3d5f21bd7db7 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:32.932980 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-cc0a2681-3ffc-44e7-b3c4-3d5f21bd7db7 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:32.939336 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc0a2681-3ffc-44e7-b3c4-3d5f21bd7db7 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:32.939825 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc0a2681-3ffc-44e7-b3c4-3d5f21bd7db7 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:32.940266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc0a2681-3ffc-44e7-b3c4-3d5f21bd7db7 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:32.940989 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc0a2681-3ffc-44e7-b3c4-3d5f21bd7db7 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:32.941449 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc0a2681-3ffc-44e7-b3c4-3d5f21bd7db7 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:32.941879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cc0a2681-3ffc-44e7-b3c4-3d5f21bd7db7 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:33.070443 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cc0a2681-3ffc-44e7-b3c4-3d5f21bd7db7 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:33.078020 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-cc0a2681-3ffc-44e7-b3c4-3d5f21bd7db7 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1315 microversion: 2.1 time: 0.150131 Aug 24 16:57:33.078585 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 401/807] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:32 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:33.583191 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8a804ed2-e89a-4108-bef2-9b966aa29d02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:33.583960 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8a804ed2-e89a-4108-bef2-9b966aa29d02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:33.591094 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a804ed2-e89a-4108-bef2-9b966aa29d02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:33.591576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a804ed2-e89a-4108-bef2-9b966aa29d02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:33.592016 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a804ed2-e89a-4108-bef2-9b966aa29d02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:33.592740 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a804ed2-e89a-4108-bef2-9b966aa29d02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:33.593193 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a804ed2-e89a-4108-bef2-9b966aa29d02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:33.593627 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a804ed2-e89a-4108-bef2-9b966aa29d02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:33.721829 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8a804ed2-e89a-4108-bef2-9b966aa29d02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:33.729841 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8a804ed2-e89a-4108-bef2-9b966aa29d02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:33.731441 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8a804ed2-e89a-4108-bef2-9b966aa29d02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:33.732626 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8a804ed2-e89a-4108-bef2-9b966aa29d02 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1744 microversion: 2.20 time: 0.153373 Aug 24 16:57:33.733182 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 407/808] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:33 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:34.098168 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-cda92482-0716-46a1-93ab-e28de0dbf3d0 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:34.098785 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-cda92482-0716-46a1-93ab-e28de0dbf3d0 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:34.105767 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cda92482-0716-46a1-93ab-e28de0dbf3d0 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:34.107128 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cda92482-0716-46a1-93ab-e28de0dbf3d0 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:34.107128 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cda92482-0716-46a1-93ab-e28de0dbf3d0 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:34.107383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cda92482-0716-46a1-93ab-e28de0dbf3d0 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:34.107846 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cda92482-0716-46a1-93ab-e28de0dbf3d0 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:34.108277 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cda92482-0716-46a1-93ab-e28de0dbf3d0 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:34.238949 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cda92482-0716-46a1-93ab-e28de0dbf3d0 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:34.246480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-cda92482-0716-46a1-93ab-e28de0dbf3d0 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1315 microversion: 2.1 time: 0.152242 Aug 24 16:57:34.247042 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 402/809] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:34 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:34.755363 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7560e6de-75b1-4f07-bd45-c6f38b865e39 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:34.755972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7560e6de-75b1-4f07-bd45-c6f38b865e39 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:34.759041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:34.759817 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=6 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:34.764331 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7560e6de-75b1-4f07-bd45-c6f38b865e39 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:34.764845 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7560e6de-75b1-4f07-bd45-c6f38b865e39 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:34.765280 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7560e6de-75b1-4f07-bd45-c6f38b865e39 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:34.765953 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7560e6de-75b1-4f07-bd45-c6f38b865e39 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:34.766401 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7560e6de-75b1-4f07-bd45-c6f38b865e39 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:34.766816 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7560e6de-75b1-4f07-bd45-c6f38b865e39 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:34.894300 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7560e6de-75b1-4f07-bd45-c6f38b865e39 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:34.902348 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7560e6de-75b1-4f07-bd45-c6f38b865e39 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:34.903846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7560e6de-75b1-4f07-bd45-c6f38b865e39 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:34.905032 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7560e6de-75b1-4f07-bd45-c6f38b865e39 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1744 microversion: 2.20 time: 0.153818 Aug 24 16:57:34.905592 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 408/810] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:34 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:35.267416 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-66fef949-d8cb-4170-bcab-69e43f3cfe1a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:35.268027 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-66fef949-d8cb-4170-bcab-69e43f3cfe1a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:35.269872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:35.275088 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66fef949-d8cb-4170-bcab-69e43f3cfe1a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:35.275570 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66fef949-d8cb-4170-bcab-69e43f3cfe1a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:35.276009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66fef949-d8cb-4170-bcab-69e43f3cfe1a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:35.276720 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66fef949-d8cb-4170-bcab-69e43f3cfe1a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:35.277171 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66fef949-d8cb-4170-bcab-69e43f3cfe1a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:35.277591 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-66fef949-d8cb-4170-bcab-69e43f3cfe1a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:35.414993 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-66fef949-d8cb-4170-bcab-69e43f3cfe1a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:35.416978 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-66fef949-d8cb-4170-bcab-69e43f3cfe1a tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1315 microversion: 2.1 time: 0.153467 Aug 24 16:57:35.417545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 403/811] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:35 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:35.928345 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f4a6e406-fc8a-410e-bdf1-11b5fea70587 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:35.928986 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f4a6e406-fc8a-410e-bdf1-11b5fea70587 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:35.935972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4a6e406-fc8a-410e-bdf1-11b5fea70587 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:35.936475 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4a6e406-fc8a-410e-bdf1-11b5fea70587 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:35.936914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4a6e406-fc8a-410e-bdf1-11b5fea70587 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:35.937594 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4a6e406-fc8a-410e-bdf1-11b5fea70587 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:35.938040 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4a6e406-fc8a-410e-bdf1-11b5fea70587 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:35.938454 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4a6e406-fc8a-410e-bdf1-11b5fea70587 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:36.069579 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f4a6e406-fc8a-410e-bdf1-11b5fea70587 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:36.077789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f4a6e406-fc8a-410e-bdf1-11b5fea70587 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:36.079279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f4a6e406-fc8a-410e-bdf1-11b5fea70587 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:36.080449 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f4a6e406-fc8a-410e-bdf1-11b5fea70587 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1744 microversion: 2.20 time: 0.156757 Aug 24 16:57:36.081006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 409/812] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:35 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:36.208020 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-752265ee-e664-422b-b808-b4c55a0c21be req-49958448-4d3e-4a33-8d3a-5e86b8536dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb67c2a-9f17-4898-9f29-ad435aab9781", "name": "network-vif-plugged", "status": "completed", "tag": "0986ce52-2371-4aff-8130-e230b0c37601"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:36.217932 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-752265ee-e664-422b-b808-b4c55a0c21be req-49958448-4d3e-4a33-8d3a-5e86b8536dd3 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:36.218499 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-752265ee-e664-422b-b808-b4c55a0c21be req-49958448-4d3e-4a33-8d3a-5e86b8536dd3 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:36.218915 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-752265ee-e664-422b-b808-b4c55a0c21be req-49958448-4d3e-4a33-8d3a-5e86b8536dd3 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:36.232199 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-752265ee-e664-422b-b808-b4c55a0c21be req-49958448-4d3e-4a33-8d3a-5e86b8536dd3 service nova] Creating event network-vif-plugged:0986ce52-2371-4aff-8130-e230b0c37601 for instance aeb67c2a-9f17-4898-9f29-ad435aab9781 on hv-cinder-85220 Aug 24 16:57:36.237468 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-752265ee-e664-422b-b808-b4c55a0c21be req-49958448-4d3e-4a33-8d3a-5e86b8536dd3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033021 Aug 24 16:57:36.238064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 404/813] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:36.438114 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dafcf646-d637-44e1-9da6-a5f94ab9f5c1 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:36.438818 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dafcf646-d637-44e1-9da6-a5f94ab9f5c1 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:36.445731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dafcf646-d637-44e1-9da6-a5f94ab9f5c1 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:36.446224 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dafcf646-d637-44e1-9da6-a5f94ab9f5c1 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:36.446684 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dafcf646-d637-44e1-9da6-a5f94ab9f5c1 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:36.447478 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dafcf646-d637-44e1-9da6-a5f94ab9f5c1 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:36.447933 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dafcf646-d637-44e1-9da6-a5f94ab9f5c1 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:36.448350 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dafcf646-d637-44e1-9da6-a5f94ab9f5c1 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:36.467563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=100 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:36.597715 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-dafcf646-d637-44e1-9da6-a5f94ab9f5c1 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:36.606145 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dafcf646-d637-44e1-9da6-a5f94ab9f5c1 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1315 microversion: 2.1 time: 0.171950 Aug 24 16:57:36.607026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 410/814] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:36 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:37.104234 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4e47f0f8-0deb-4182-a3da-d4c216b7916f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:37.104981 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4e47f0f8-0deb-4182-a3da-d4c216b7916f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:37.111524 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4e47f0f8-0deb-4182-a3da-d4c216b7916f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:37.112009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4e47f0f8-0deb-4182-a3da-d4c216b7916f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:37.112469 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4e47f0f8-0deb-4182-a3da-d4c216b7916f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:37.113164 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4e47f0f8-0deb-4182-a3da-d4c216b7916f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:37.113620 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4e47f0f8-0deb-4182-a3da-d4c216b7916f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:37.114047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4e47f0f8-0deb-4182-a3da-d4c216b7916f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:37.240959 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4e47f0f8-0deb-4182-a3da-d4c216b7916f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:37.248998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4e47f0f8-0deb-4182-a3da-d4c216b7916f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:37.250501 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4e47f0f8-0deb-4182-a3da-d4c216b7916f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:37.251660 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4e47f0f8-0deb-4182-a3da-d4c216b7916f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1744 microversion: 2.20 time: 0.152311 Aug 24 16:57:37.252220 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 405/815] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:37 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:37.627582 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-23d9f330-a151-4924-9b2f-0b29d148d35e tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:37.628200 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-23d9f330-a151-4924-9b2f-0b29d148d35e tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:37.635271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23d9f330-a151-4924-9b2f-0b29d148d35e tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:37.635754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23d9f330-a151-4924-9b2f-0b29d148d35e tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:37.636189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23d9f330-a151-4924-9b2f-0b29d148d35e tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:37.636905 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23d9f330-a151-4924-9b2f-0b29d148d35e tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:37.637363 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23d9f330-a151-4924-9b2f-0b29d148d35e tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:37.637790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23d9f330-a151-4924-9b2f-0b29d148d35e tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:37.766786 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-23d9f330-a151-4924-9b2f-0b29d148d35e tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:37.774383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-23d9f330-a151-4924-9b2f-0b29d148d35e tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1315 microversion: 2.1 time: 0.150650 Aug 24 16:57:37.774945 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 411/816] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:37 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:38.252004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-1c02e52a-3594-408f-bb26-55f30d28d4f3 req-2da7fc2a-6aff-4d44-9cd8-b54e82a45c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d1714b-1531-428f-a205-e42cedf76d9b", "name": "network-vif-plugged", "status": "completed", "tag": "629e65e7-9a31-4acf-8a66-2220e5591487"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:38.262146 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-1c02e52a-3594-408f-bb26-55f30d28d4f3 req-2da7fc2a-6aff-4d44-9cd8-b54e82a45c2e service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:38.262632 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-1c02e52a-3594-408f-bb26-55f30d28d4f3 req-2da7fc2a-6aff-4d44-9cd8-b54e82a45c2e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:38.263068 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-1c02e52a-3594-408f-bb26-55f30d28d4f3 req-2da7fc2a-6aff-4d44-9cd8-b54e82a45c2e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:38.275045 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-49855fba-95de-451d-9ab7-07b708e0696f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:38.275573 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-1c02e52a-3594-408f-bb26-55f30d28d4f3 req-2da7fc2a-6aff-4d44-9cd8-b54e82a45c2e service nova] Creating event network-vif-plugged:629e65e7-9a31-4acf-8a66-2220e5591487 for instance 09d1714b-1531-428f-a205-e42cedf76d9b on hv-cinder-85220 Aug 24 16:57:38.276149 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-49855fba-95de-451d-9ab7-07b708e0696f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:38.280814 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-1c02e52a-3594-408f-bb26-55f30d28d4f3 req-2da7fc2a-6aff-4d44-9cd8-b54e82a45c2e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032402 Aug 24 16:57:38.281596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 406/817] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:38.283719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49855fba-95de-451d-9ab7-07b708e0696f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:38.284201 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49855fba-95de-451d-9ab7-07b708e0696f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:38.284668 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49855fba-95de-451d-9ab7-07b708e0696f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:38.285363 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49855fba-95de-451d-9ab7-07b708e0696f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:38.285812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49855fba-95de-451d-9ab7-07b708e0696f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:38.286227 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49855fba-95de-451d-9ab7-07b708e0696f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:38.416128 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-49855fba-95de-451d-9ab7-07b708e0696f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:38.424349 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-49855fba-95de-451d-9ab7-07b708e0696f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:38.425896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-49855fba-95de-451d-9ab7-07b708e0696f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:38.427033 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-49855fba-95de-451d-9ab7-07b708e0696f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1744 microversion: 2.20 time: 0.156263 Aug 24 16:57:38.427581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 412/818] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:38 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:38.800360 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-eadf36ed-2c09-4878-bae8-132cf703711c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:38.800360 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-eadf36ed-2c09-4878-bae8-132cf703711c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:38.805653 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eadf36ed-2c09-4878-bae8-132cf703711c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:38.806200 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eadf36ed-2c09-4878-bae8-132cf703711c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:38.806634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eadf36ed-2c09-4878-bae8-132cf703711c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:38.807359 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eadf36ed-2c09-4878-bae8-132cf703711c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:38.807809 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eadf36ed-2c09-4878-bae8-132cf703711c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:38.808227 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eadf36ed-2c09-4878-bae8-132cf703711c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:38.940063 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-eadf36ed-2c09-4878-bae8-132cf703711c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:38.948843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-eadf36ed-2c09-4878-bae8-132cf703711c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1464 microversion: 2.1 time: 0.154453 Aug 24 16:57:38.955138 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 407/819] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:38 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:38.994811 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-91172388-999f-441e-8b0a-669d29d5d67c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:38.995307 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-91172388-999f-441e-8b0a-669d29d5d67c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:39.001756 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91172388-999f-441e-8b0a-669d29d5d67c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:39.002295 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91172388-999f-441e-8b0a-669d29d5d67c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:39.002728 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91172388-999f-441e-8b0a-669d29d5d67c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:39.003422 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91172388-999f-441e-8b0a-669d29d5d67c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:39.003874 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91172388-999f-441e-8b0a-669d29d5d67c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:39.004517 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91172388-999f-441e-8b0a-669d29d5d67c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:39.033584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-91172388-999f-441e-8b0a-669d29d5d67c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:57:39.386566 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-91172388-999f-441e-8b0a-669d29d5d67c tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "DELETE /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 204 len: 0 microversion: 2.1 time: 0.395324 Aug 24 16:57:39.387150 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 413/820] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:57:38 2022] DELETE /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:57:39.395655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1d568b96-26f3-47ae-b40a-d365f1b602cb tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:39.396279 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1d568b96-26f3-47ae-b40a-d365f1b602cb tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:39.402800 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d568b96-26f3-47ae-b40a-d365f1b602cb tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:39.403292 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d568b96-26f3-47ae-b40a-d365f1b602cb tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:39.403733 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d568b96-26f3-47ae-b40a-d365f1b602cb tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:39.404526 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d568b96-26f3-47ae-b40a-d365f1b602cb tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:39.404946 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d568b96-26f3-47ae-b40a-d365f1b602cb tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:39.405376 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d568b96-26f3-47ae-b40a-d365f1b602cb tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:39.452016 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-269a430b-bb28-4a8f-8ec1-afcfd3aeb265 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:39.452754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-269a430b-bb28-4a8f-8ec1-afcfd3aeb265 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:39.458949 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-269a430b-bb28-4a8f-8ec1-afcfd3aeb265 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:39.459435 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-269a430b-bb28-4a8f-8ec1-afcfd3aeb265 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:39.459873 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-269a430b-bb28-4a8f-8ec1-afcfd3aeb265 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:39.460634 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-269a430b-bb28-4a8f-8ec1-afcfd3aeb265 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:39.461098 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-269a430b-bb28-4a8f-8ec1-afcfd3aeb265 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:39.461528 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-269a430b-bb28-4a8f-8ec1-afcfd3aeb265 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:39.630838 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1d568b96-26f3-47ae-b40a-d365f1b602cb tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:39.645286 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1d568b96-26f3-47ae-b40a-d365f1b602cb tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1470 microversion: 2.1 time: 0.253460 Aug 24 16:57:39.646982 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 408/821] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:39 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1470 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:39.668702 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-269a430b-bb28-4a8f-8ec1-afcfd3aeb265 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:39.677894 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-269a430b-bb28-4a8f-8ec1-afcfd3aeb265 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:39.680095 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-269a430b-bb28-4a8f-8ec1-afcfd3aeb265 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:39.681393 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-269a430b-bb28-4a8f-8ec1-afcfd3aeb265 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1739 microversion: 2.20 time: 0.233838 Aug 24 16:57:39.696470 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 414/822] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:39 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:57:40.669951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f8469735-9fe9-431f-a092-1dab8fab82d2 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:40.670923 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f8469735-9fe9-431f-a092-1dab8fab82d2 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:40.678766 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8469735-9fe9-431f-a092-1dab8fab82d2 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:40.679264 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8469735-9fe9-431f-a092-1dab8fab82d2 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:40.679732 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8469735-9fe9-431f-a092-1dab8fab82d2 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:40.680462 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8469735-9fe9-431f-a092-1dab8fab82d2 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:40.680936 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8469735-9fe9-431f-a092-1dab8fab82d2 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:40.681367 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8469735-9fe9-431f-a092-1dab8fab82d2 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:40.709396 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-32d52553-f4b8-43ae-a262-314f1ef2de0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:40.710794 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-32d52553-f4b8-43ae-a262-314f1ef2de0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:40.719399 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32d52553-f4b8-43ae-a262-314f1ef2de0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:40.719908 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32d52553-f4b8-43ae-a262-314f1ef2de0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:40.720575 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32d52553-f4b8-43ae-a262-314f1ef2de0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:40.721498 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32d52553-f4b8-43ae-a262-314f1ef2de0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:40.722103 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32d52553-f4b8-43ae-a262-314f1ef2de0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:40.722677 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32d52553-f4b8-43ae-a262-314f1ef2de0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:40.889987 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f8469735-9fe9-431f-a092-1dab8fab82d2 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:40.894328 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:40.899513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f8469735-9fe9-431f-a092-1dab8fab82d2 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1470 microversion: 2.1 time: 0.235485 Aug 24 16:57:40.900099 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 409/823] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:40 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1470 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:40.930910 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-32d52553-f4b8-43ae-a262-314f1ef2de0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:40.941405 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-32d52553-f4b8-43ae-a262-314f1ef2de0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:40.943433 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-32d52553-f4b8-43ae-a262-314f1ef2de0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:40.944851 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-32d52553-f4b8-43ae-a262-314f1ef2de0c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1739 microversion: 2.20 time: 0.243250 Aug 24 16:57:40.946491 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 415/824] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:40 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:41.697583 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-271c480c-547e-44d3-94a5-c9f446d99cf7 req-ecb72155-0cbf-4e17-abfe-9b242035cdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb67c2a-9f17-4898-9f29-ad435aab9781", "name": "network-vif-deleted", "tag": "0986ce52-2371-4aff-8130-e230b0c37601"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:41.708461 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-271c480c-547e-44d3-94a5-c9f446d99cf7 req-ecb72155-0cbf-4e17-abfe-9b242035cdc5 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:41.709595 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-271c480c-547e-44d3-94a5-c9f446d99cf7 req-ecb72155-0cbf-4e17-abfe-9b242035cdc5 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:41.710438 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-271c480c-547e-44d3-94a5-c9f446d99cf7 req-ecb72155-0cbf-4e17-abfe-9b242035cdc5 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:41.724052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-271c480c-547e-44d3-94a5-c9f446d99cf7 req-ecb72155-0cbf-4e17-abfe-9b242035cdc5 service nova] Creating event network-vif-deleted:0986ce52-2371-4aff-8130-e230b0c37601 for instance aeb67c2a-9f17-4898-9f29-ad435aab9781 on hv-cinder-85220 Aug 24 16:57:41.732710 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-271c480c-547e-44d3-94a5-c9f446d99cf7 req-ecb72155-0cbf-4e17-abfe-9b242035cdc5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037769 Aug 24 16:57:41.734163 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 410/825] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:41.923359 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-875dc115-1955-472f-b3b7-45cbac316841 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:41.924636 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-875dc115-1955-472f-b3b7-45cbac316841 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:41.931425 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-875dc115-1955-472f-b3b7-45cbac316841 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:41.931917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-875dc115-1955-472f-b3b7-45cbac316841 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:41.932358 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-875dc115-1955-472f-b3b7-45cbac316841 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:41.933093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-875dc115-1955-472f-b3b7-45cbac316841 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:41.933559 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-875dc115-1955-472f-b3b7-45cbac316841 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:41.933996 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-875dc115-1955-472f-b3b7-45cbac316841 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:41.969389 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-efdf7fab-156d-41b9-9fac-98b47c57431d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:41.970154 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-efdf7fab-156d-41b9-9fac-98b47c57431d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:41.976713 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-efdf7fab-156d-41b9-9fac-98b47c57431d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:41.977327 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-efdf7fab-156d-41b9-9fac-98b47c57431d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:41.978058 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-efdf7fab-156d-41b9-9fac-98b47c57431d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:41.987238 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-efdf7fab-156d-41b9-9fac-98b47c57431d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:41.988969 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-efdf7fab-156d-41b9-9fac-98b47c57431d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:41.989742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-efdf7fab-156d-41b9-9fac-98b47c57431d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:42.014646 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-875dc115-1955-472f-b3b7-45cbac316841 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77c2b9101541da83f67b69990fa205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebba8d99c8847ddb971578fb19cd6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:42.026230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-875dc115-1955-472f-b3b7-45cbac316841 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 200 len: 1300 microversion: 2.1 time: 0.106788 Aug 24 16:57:42.027099 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 416/826] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:41 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:57:42.159925 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-efdf7fab-156d-41b9-9fac-98b47c57431d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:42.168692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-efdf7fab-156d-41b9-9fac-98b47c57431d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:42.170374 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-efdf7fab-156d-41b9-9fac-98b47c57431d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:42.171867 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-efdf7fab-156d-41b9-9fac-98b47c57431d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1739 microversion: 2.20 time: 0.206846 Aug 24 16:57:42.172663 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 411/827] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:41 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:57:43.047231 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e2128ca9-542c-4579-9255-5cf826057b79 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:43.047769 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e2128ca9-542c-4579-9255-5cf826057b79 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] [instance: aeb67c2a-9f17-4898-9f29-ad435aab9781] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:43.054069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2128ca9-542c-4579-9255-5cf826057b79 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:43.054862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2128ca9-542c-4579-9255-5cf826057b79 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:43.055301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2128ca9-542c-4579-9255-5cf826057b79 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:43.056001 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2128ca9-542c-4579-9255-5cf826057b79 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:43.056516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2128ca9-542c-4579-9255-5cf826057b79 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:43.062436 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2128ca9-542c-4579-9255-5cf826057b79 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:43.073093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-e2128ca9-542c-4579-9255-5cf826057b79 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] HTTP exception thrown: Instance aeb67c2a-9f17-4898-9f29-ad435aab9781 could not be found. Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e2128ca9-542c-4579-9255-5cf826057b79 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Request method failure captured: Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 HTTP/1.1 Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlhy_oclDmawaIwKMVEotRmGFhxfIqIpcNmY8UjIPmDvKqJU1oRlAqtXn59ORCmyH8lEaTq8O3rUANnIrt9CRYtCdgULUsJB7iLdJIVo0LuK-FE0GGggnxEUp-QPhW0sif14egs3rTAQIyApoDTCxIA-uskD83mg4pVf25CeTG8k_HM Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 9ebba8d99c8847ddb971578fb19cd6e2 Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-VolumesNegativeTest-496090053 Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:57:43.074992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:57:43.076667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9ebba8d99c8847ddb971578fb19cd6e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9ebba8d99c8847ddb971578fb19cd6e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9ebba8d99c8847ddb971578fb19cd6e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9ebba8d99c8847ddb971578fb19cd6e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:57:43.076667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-VolumesNegativeTest-496090053 Aug 24 16:57:43.076667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 9ebba8d99c8847ddb971578fb19cd6e2 Aug 24 16:57:43.076667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-VolumesNegativeTest-496090053 Aug 24 16:57:43.076667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-VolumesNegativeTest-496090053-project Aug 24 16:57:43.076667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:57:43.076667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:57:43.076667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 2c77c2b9101541da83f67b69990fa205 Aug 24 16:57:43.076667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-VolumesNegativeTest-496090053-project Aug 24 16:57:43.076667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:57:43.076667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance aeb67c2a-9f17-4898-9f29-ad435aab9781 could not be found. Aug 24 16:57:43.076667 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': 'aeb67c2a-9f17-4898-9f29-ad435aab9781'} Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeb67c2a-9f17-4898-9f29-ad435aab9781 could not be found. Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:57:43.077635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeb67c2a-9f17-4898-9f29-ad435aab9781 could not be found. Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeb67c2a-9f17-4898-9f29-ad435aab9781 could not be found. Aug 24 16:57:43.079185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:57:43.081327 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e2128ca9-542c-4579-9255-5cf826057b79 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] Returning 404 to user: Instance aeb67c2a-9f17-4898-9f29-ad435aab9781 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:57:43.082873 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e2128ca9-542c-4579-9255-5cf826057b79 tempest-VolumesNegativeTest-496090053 tempest-VolumesNegativeTest-496090053-project] 10.222.0.70 "GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781" status: 404 len: 111 microversion: 2.1 time: 0.039133 Aug 24 16:57:43.083599 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 417/828] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:43 2022] GET /compute/v2.1/servers/aeb67c2a-9f17-4898-9f29-ad435aab9781 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:57:43.199610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-79cc7216-79a0-42ea-a929-84253f5a5123 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:43.200418 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-79cc7216-79a0-42ea-a929-84253f5a5123 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:43.212226 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-79cc7216-79a0-42ea-a929-84253f5a5123 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:43.212973 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-79cc7216-79a0-42ea-a929-84253f5a5123 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:43.213569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-79cc7216-79a0-42ea-a929-84253f5a5123 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:43.214419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-79cc7216-79a0-42ea-a929-84253f5a5123 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:43.215396 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-79cc7216-79a0-42ea-a929-84253f5a5123 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:43.216760 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-79cc7216-79a0-42ea-a929-84253f5a5123 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:43.389773 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-79cc7216-79a0-42ea-a929-84253f5a5123 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:43.402860 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-79cc7216-79a0-42ea-a929-84253f5a5123 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:43.405304 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-79cc7216-79a0-42ea-a929-84253f5a5123 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:43.417052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-79cc7216-79a0-42ea-a929-84253f5a5123 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1739 microversion: 2.20 time: 0.213408 Aug 24 16:57:43.437642 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 412/829] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:43 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:44.446019 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ba627e61-3ac4-4da1-b887-f5b56ff9b2de tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:44.447268 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ba627e61-3ac4-4da1-b887-f5b56ff9b2de tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:44.454776 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba627e61-3ac4-4da1-b887-f5b56ff9b2de tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:44.455656 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba627e61-3ac4-4da1-b887-f5b56ff9b2de tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:44.456448 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba627e61-3ac4-4da1-b887-f5b56ff9b2de tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:44.457402 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba627e61-3ac4-4da1-b887-f5b56ff9b2de tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:44.458091 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba627e61-3ac4-4da1-b887-f5b56ff9b2de tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:44.458733 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba627e61-3ac4-4da1-b887-f5b56ff9b2de tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:44.625260 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ba627e61-3ac4-4da1-b887-f5b56ff9b2de tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:44.635500 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ba627e61-3ac4-4da1-b887-f5b56ff9b2de tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:44.637488 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ba627e61-3ac4-4da1-b887-f5b56ff9b2de tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:44.638839 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ba627e61-3ac4-4da1-b887-f5b56ff9b2de tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1739 microversion: 2.20 time: 0.196994 Aug 24 16:57:44.639703 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 418/830] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:44 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:45.670326 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9e82a1cf-bebd-42cb-9efe-0ae120731795 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:45.671135 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9e82a1cf-bebd-42cb-9efe-0ae120731795 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:45.678429 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e82a1cf-bebd-42cb-9efe-0ae120731795 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:45.683555 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e82a1cf-bebd-42cb-9efe-0ae120731795 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:45.683555 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e82a1cf-bebd-42cb-9efe-0ae120731795 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:45.683555 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e82a1cf-bebd-42cb-9efe-0ae120731795 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:45.683555 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e82a1cf-bebd-42cb-9efe-0ae120731795 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:45.683951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e82a1cf-bebd-42cb-9efe-0ae120731795 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:45.820848 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9e82a1cf-bebd-42cb-9efe-0ae120731795 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:45.840626 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9e82a1cf-bebd-42cb-9efe-0ae120731795 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:45.842412 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9e82a1cf-bebd-42cb-9efe-0ae120731795 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:45.843840 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9e82a1cf-bebd-42cb-9efe-0ae120731795 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1739 microversion: 2.20 time: 0.177407 Aug 24 16:57:45.844438 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 413/831] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:45 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:46.867749 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-31435e64-c8d6-4048-8dca-7e0bea658a81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:46.870994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-31435e64-c8d6-4048-8dca-7e0bea658a81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:46.886197 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31435e64-c8d6-4048-8dca-7e0bea658a81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:46.896988 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31435e64-c8d6-4048-8dca-7e0bea658a81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:46.899863 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31435e64-c8d6-4048-8dca-7e0bea658a81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:46.902474 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31435e64-c8d6-4048-8dca-7e0bea658a81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:46.904649 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31435e64-c8d6-4048-8dca-7e0bea658a81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:46.905225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31435e64-c8d6-4048-8dca-7e0bea658a81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:46.914207 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3f96613a-a134-4bbf-b845-226a579d1512 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:46.914710 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3f96613a-a134-4bbf-b845-226a579d1512 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:46.927994 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3f96613a-a134-4bbf-b845-226a579d1512 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:46.928530 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3f96613a-a134-4bbf-b845-226a579d1512 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:46.929392 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3f96613a-a134-4bbf-b845-226a579d1512 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:46.930265 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3f96613a-a134-4bbf-b845-226a579d1512 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:46.930885 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3f96613a-a134-4bbf-b845-226a579d1512 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:46.931465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3f96613a-a134-4bbf-b845-226a579d1512 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:46.970979 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3f96613a-a134-4bbf-b845-226a579d1512 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Going to try to terminate instance {{(pid=127715) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:57:47.097807 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-31435e64-c8d6-4048-8dca-7e0bea658a81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:47.114510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-31435e64-c8d6-4048-8dca-7e0bea658a81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:47.114510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-31435e64-c8d6-4048-8dca-7e0bea658a81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:47.114510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-31435e64-c8d6-4048-8dca-7e0bea658a81 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1739 microversion: 2.20 time: 0.247871 Aug 24 16:57:47.126906 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 419/832] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:46 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:47.133347 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-5f4c5bb1-f9d3-4268-80f2-8817cdac5142 req-b9fdc7fd-38d6-4246-b7dd-8ee92cad8956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62dfce7d-d2d5-4695-948f-8381f4ea6a91", "tag": "3cf062b3-088f-4bbb-91b9-d4ca915fdc9c"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:47.145549 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-5f4c5bb1-f9d3-4268-80f2-8817cdac5142 req-b9fdc7fd-38d6-4246-b7dd-8ee92cad8956 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:47.146298 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-5f4c5bb1-f9d3-4268-80f2-8817cdac5142 req-b9fdc7fd-38d6-4246-b7dd-8ee92cad8956 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:47.147242 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-5f4c5bb1-f9d3-4268-80f2-8817cdac5142 req-b9fdc7fd-38d6-4246-b7dd-8ee92cad8956 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:47.162723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-5f4c5bb1-f9d3-4268-80f2-8817cdac5142 req-b9fdc7fd-38d6-4246-b7dd-8ee92cad8956 service nova] Creating event network-changed:3cf062b3-088f-4bbb-91b9-d4ca915fdc9c for instance 62dfce7d-d2d5-4695-948f-8381f4ea6a91 on hv-cinder-85220 Aug 24 16:57:47.169408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-5f4c5bb1-f9d3-4268-80f2-8817cdac5142 req-b9fdc7fd-38d6-4246-b7dd-8ee92cad8956 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041034 Aug 24 16:57:47.170300 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 420/833] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:47.392099 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3f96613a-a134-4bbf-b845-226a579d1512 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "DELETE /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 204 len: 0 microversion: 2.1 time: 0.482826 Aug 24 16:57:47.393715 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 414/834] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:57:46 2022] DELETE /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:47.403071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e6d3cf1e-78f0-4740-a011-eaa962d9f0ba tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:47.404170 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e6d3cf1e-78f0-4740-a011-eaa962d9f0ba tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:47.418137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6d3cf1e-78f0-4740-a011-eaa962d9f0ba tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:47.420463 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6d3cf1e-78f0-4740-a011-eaa962d9f0ba tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:47.421550 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6d3cf1e-78f0-4740-a011-eaa962d9f0ba tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:47.425598 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6d3cf1e-78f0-4740-a011-eaa962d9f0ba tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:47.430158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6d3cf1e-78f0-4740-a011-eaa962d9f0ba tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:47.430733 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6d3cf1e-78f0-4740-a011-eaa962d9f0ba tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:47.622841 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6d3cf1e-78f0-4740-a011-eaa962d9f0ba tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:47.634784 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e6d3cf1e-78f0-4740-a011-eaa962d9f0ba tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.236523 Aug 24 16:57:47.636130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 421/835] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:47 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:48.146814 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-151371f4-8c93-4abf-841d-8584c44a8858 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:48.147619 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-151371f4-8c93-4abf-841d-8584c44a8858 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:48.179698 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-151371f4-8c93-4abf-841d-8584c44a8858 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:48.180210 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-151371f4-8c93-4abf-841d-8584c44a8858 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:48.180690 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-151371f4-8c93-4abf-841d-8584c44a8858 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:48.181409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-151371f4-8c93-4abf-841d-8584c44a8858 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:48.181866 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-151371f4-8c93-4abf-841d-8584c44a8858 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:48.182290 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-151371f4-8c93-4abf-841d-8584c44a8858 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:48.404026 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-151371f4-8c93-4abf-841d-8584c44a8858 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:48.412489 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-151371f4-8c93-4abf-841d-8584c44a8858 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:48.414631 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-151371f4-8c93-4abf-841d-8584c44a8858 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:48.415672 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-151371f4-8c93-4abf-841d-8584c44a8858 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1739 microversion: 2.20 time: 0.278899 Aug 24 16:57:48.416248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 415/836] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:48 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:48.659507 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f1843d32-4a5a-4e24-9f99-67094e7b0010 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:48.660028 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f1843d32-4a5a-4e24-9f99-67094e7b0010 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:48.671757 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1843d32-4a5a-4e24-9f99-67094e7b0010 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:48.672248 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1843d32-4a5a-4e24-9f99-67094e7b0010 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:48.678020 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1843d32-4a5a-4e24-9f99-67094e7b0010 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:48.683839 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1843d32-4a5a-4e24-9f99-67094e7b0010 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:48.684444 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1843d32-4a5a-4e24-9f99-67094e7b0010 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:48.684878 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1843d32-4a5a-4e24-9f99-67094e7b0010 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:48.852733 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f1843d32-4a5a-4e24-9f99-67094e7b0010 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:48.863299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f1843d32-4a5a-4e24-9f99-67094e7b0010 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1569 microversion: 2.1 time: 0.208113 Aug 24 16:57:48.869400 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 422/837] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:48 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:49.439374 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d8cc7bc4-5152-4a1e-a6c9-3c74fdf24251 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:49.440063 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d8cc7bc4-5152-4a1e-a6c9-3c74fdf24251 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:49.447087 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8cc7bc4-5152-4a1e-a6c9-3c74fdf24251 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:49.447669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8cc7bc4-5152-4a1e-a6c9-3c74fdf24251 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:49.448113 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8cc7bc4-5152-4a1e-a6c9-3c74fdf24251 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:49.448840 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8cc7bc4-5152-4a1e-a6c9-3c74fdf24251 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:49.449294 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8cc7bc4-5152-4a1e-a6c9-3c74fdf24251 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:49.449705 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d8cc7bc4-5152-4a1e-a6c9-3c74fdf24251 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:49.584351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d8cc7bc4-5152-4a1e-a6c9-3c74fdf24251 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:49.599750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d8cc7bc4-5152-4a1e-a6c9-3c74fdf24251 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:49.601366 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d8cc7bc4-5152-4a1e-a6c9-3c74fdf24251 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:49.602524 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d8cc7bc4-5152-4a1e-a6c9-3c74fdf24251 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1739 microversion: 2.20 time: 0.167304 Aug 24 16:57:49.603088 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 416/838] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:49 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:49.889325 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5b957ce1-5456-41e8-a390-787a339675c6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:49.891069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5b957ce1-5456-41e8-a390-787a339675c6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:49.906901 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b957ce1-5456-41e8-a390-787a339675c6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:49.907392 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b957ce1-5456-41e8-a390-787a339675c6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:49.907835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b957ce1-5456-41e8-a390-787a339675c6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:49.908634 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b957ce1-5456-41e8-a390-787a339675c6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:49.909176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b957ce1-5456-41e8-a390-787a339675c6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:49.909522 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b957ce1-5456-41e8-a390-787a339675c6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:49.980693 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5b957ce1-5456-41e8-a390-787a339675c6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:49.993976 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5b957ce1-5456-41e8-a390-787a339675c6 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1382 microversion: 2.1 time: 0.108699 Aug 24 16:57:49.995711 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 423/839] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:49 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1382 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:50.010891 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-56f2dff2-0a54-46f0-b2e9-4731f08feb41 req-7b273f1c-1225-43d3-92cb-da2b66f3e4af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62dfce7d-d2d5-4695-948f-8381f4ea6a91", "name": "network-vif-deleted", "tag": "3cf062b3-088f-4bbb-91b9-d4ca915fdc9c"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:50.028756 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-56f2dff2-0a54-46f0-b2e9-4731f08feb41 req-7b273f1c-1225-43d3-92cb-da2b66f3e4af service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:50.028756 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-56f2dff2-0a54-46f0-b2e9-4731f08feb41 req-7b273f1c-1225-43d3-92cb-da2b66f3e4af service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:50.028756 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-56f2dff2-0a54-46f0-b2e9-4731f08feb41 req-7b273f1c-1225-43d3-92cb-da2b66f3e4af service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:50.038571 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-56f2dff2-0a54-46f0-b2e9-4731f08feb41 req-7b273f1c-1225-43d3-92cb-da2b66f3e4af service nova] Creating event network-vif-deleted:3cf062b3-088f-4bbb-91b9-d4ca915fdc9c for instance 62dfce7d-d2d5-4695-948f-8381f4ea6a91 on hv-cinder-85220 Aug 24 16:57:50.043510 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-56f2dff2-0a54-46f0-b2e9-4731f08feb41 req-7b273f1c-1225-43d3-92cb-da2b66f3e4af service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037641 Aug 24 16:57:50.044360 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 417/840] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:50.625102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-304d908f-f66e-414b-a482-25e458d0ea75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:50.625752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-304d908f-f66e-414b-a482-25e458d0ea75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:50.631955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-304d908f-f66e-414b-a482-25e458d0ea75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:50.632455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-304d908f-f66e-414b-a482-25e458d0ea75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:50.632902 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-304d908f-f66e-414b-a482-25e458d0ea75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:50.633592 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-304d908f-f66e-414b-a482-25e458d0ea75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:50.634046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-304d908f-f66e-414b-a482-25e458d0ea75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:50.634470 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-304d908f-f66e-414b-a482-25e458d0ea75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:50.761898 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-304d908f-f66e-414b-a482-25e458d0ea75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:50.775083 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-304d908f-f66e-414b-a482-25e458d0ea75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:50.776698 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-304d908f-f66e-414b-a482-25e458d0ea75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:50.777856 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-304d908f-f66e-414b-a482-25e458d0ea75 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1739 microversion: 2.20 time: 0.156719 Aug 24 16:57:50.778437 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 424/841] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:50 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:51.019942 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:51.020657 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:51.027527 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:51.028071 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:51.028546 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:51.029246 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:51.029708 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:51.030159 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:51.063901 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:51.064395 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:51.064861 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:51.065310 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lazy-loading 'fault' on Instance uuid 62dfce7d-d2d5-4695-948f-8381f4ea6a91 {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:57:51.114169 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e3f9b6511347a692bed976865d5fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1715333032634911bcf0f7a41fab587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:51.122332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fcfd1909-b113-4de9-baee-d8b9396fbf5d tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 200 len: 1223 microversion: 2.1 time: 0.107032 Aug 24 16:57:51.123583 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 418/842] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:51 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:51.803193 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-04d32096-6a22-4149-8f26-d644c76a817e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:51.803810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-04d32096-6a22-4149-8f26-d644c76a817e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:51.811401 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04d32096-6a22-4149-8f26-d644c76a817e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:51.812098 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04d32096-6a22-4149-8f26-d644c76a817e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:51.812562 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04d32096-6a22-4149-8f26-d644c76a817e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:51.813428 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04d32096-6a22-4149-8f26-d644c76a817e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:51.813889 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04d32096-6a22-4149-8f26-d644c76a817e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:51.814341 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04d32096-6a22-4149-8f26-d644c76a817e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:51.944893 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-04d32096-6a22-4149-8f26-d644c76a817e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:51.952963 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-04d32096-6a22-4149-8f26-d644c76a817e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:51.954447 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-04d32096-6a22-4149-8f26-d644c76a817e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:51.955584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-04d32096-6a22-4149-8f26-d644c76a817e tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1739 microversion: 2.20 time: 0.156289 Aug 24 16:57:51.956138 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 425/843] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:51 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:52.143680 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-05172ab9-ecff-4418-a85a-4c2e8072ffbd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:52.143680 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-05172ab9-ecff-4418-a85a-4c2e8072ffbd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] [instance: 62dfce7d-d2d5-4695-948f-8381f4ea6a91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:52.152075 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05172ab9-ecff-4418-a85a-4c2e8072ffbd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:52.152645 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05172ab9-ecff-4418-a85a-4c2e8072ffbd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:52.153042 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05172ab9-ecff-4418-a85a-4c2e8072ffbd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:52.153742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05172ab9-ecff-4418-a85a-4c2e8072ffbd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:52.154205 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05172ab9-ecff-4418-a85a-4c2e8072ffbd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:52.154701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05172ab9-ecff-4418-a85a-4c2e8072ffbd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:52.169855 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-05172ab9-ecff-4418-a85a-4c2e8072ffbd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] HTTP exception thrown: Instance 62dfce7d-d2d5-4695-948f-8381f4ea6a91 could not be found. Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-05172ab9-ecff-4418-a85a-4c2e8072ffbd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Request method failure captured: Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 HTTP/1.1 Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlcPX3FOQL4WX3FMLJIphFEN6yynef7N-TniEBQh6cUQ1bBkZ2ygeK2GTnuyhe0pIjZwNMD__h6u1HXEuOBaz6U5JkKUtrE7QFCloKL-GdNSANLxeA08qiyvsxch2us2OFuQN7NYNmRGXj4SDxENORYizsBR8Fa3a1MNqt4nQOsrP3Y Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 1715333032634911bcf0f7a41fab587a Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-TestShelveInstance-1714216848 Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:57:52.171513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:57:52.173258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1715333032634911bcf0f7a41fab587a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1715333032634911bcf0f7a41fab587a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1715333032634911bcf0f7a41fab587a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1715333032634911bcf0f7a41fab587a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:57:52.173258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-TestShelveInstance-1714216848 Aug 24 16:57:52.173258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 1715333032634911bcf0f7a41fab587a Aug 24 16:57:52.173258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-TestShelveInstance-1714216848 Aug 24 16:57:52.173258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-TestShelveInstance-1714216848-project Aug 24 16:57:52.173258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:57:52.173258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:57:52.173258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 90e3f9b6511347a692bed976865d5fad Aug 24 16:57:52.173258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-TestShelveInstance-1714216848-project Aug 24 16:57:52.173258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:57:52.173258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 62dfce7d-d2d5-4695-948f-8381f4ea6a91 could not be found. Aug 24 16:57:52.173258 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '62dfce7d-d2d5-4695-948f-8381f4ea6a91'} Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62dfce7d-d2d5-4695-948f-8381f4ea6a91 could not be found. Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:57:52.174070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62dfce7d-d2d5-4695-948f-8381f4ea6a91 could not be found. Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62dfce7d-d2d5-4695-948f-8381f4ea6a91 could not be found. Aug 24 16:57:52.175409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:57:52.176611 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-05172ab9-ecff-4418-a85a-4c2e8072ffbd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Returning 404 to user: Instance 62dfce7d-d2d5-4695-948f-8381f4ea6a91 could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:57:52.176611 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-05172ab9-ecff-4418-a85a-4c2e8072ffbd tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91" status: 404 len: 111 microversion: 2.1 time: 0.033794 Aug 24 16:57:52.176611 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 419/844] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:52 2022] GET /compute/v2.1/servers/62dfce7d-d2d5-4695-948f-8381f4ea6a91 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:57:52.427548 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-32045fd3-7b37-4013-a81d-5fca95732180 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] Calling method '.version_select at 0x7fa19918f0d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:52.518936 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-32045fd3-7b37-4013-a81d-5fca95732180 tempest-TestShelveInstance-1714216848 tempest-TestShelveInstance-1714216848-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-341073694" status: 202 len: 0 microversion: 2.1 time: 0.095110 Aug 24 16:57:52.519537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 426/845] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Aug 24 16:57:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-341073694 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:57:52.979745 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fe45fe32-c1bc-46d0-8417-85fd732f1ef8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:52.980657 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fe45fe32-c1bc-46d0-8417-85fd732f1ef8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:52.987678 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe45fe32-c1bc-46d0-8417-85fd732f1ef8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:52.988272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe45fe32-c1bc-46d0-8417-85fd732f1ef8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:52.989638 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe45fe32-c1bc-46d0-8417-85fd732f1ef8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:52.989884 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe45fe32-c1bc-46d0-8417-85fd732f1ef8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:52.991390 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe45fe32-c1bc-46d0-8417-85fd732f1ef8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:52.991816 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe45fe32-c1bc-46d0-8417-85fd732f1ef8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:53.231861 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fe45fe32-c1bc-46d0-8417-85fd732f1ef8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:53.240802 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fe45fe32-c1bc-46d0-8417-85fd732f1ef8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:53.242670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fe45fe32-c1bc-46d0-8417-85fd732f1ef8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:53.244561 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fe45fe32-c1bc-46d0-8417-85fd732f1ef8 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1721 microversion: 2.20 time: 0.269620 Aug 24 16:57:53.245126 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 420/846] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:52 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:54.278844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fcd35912-11fb-48e6-b20a-32e7aeae0e6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:54.279471 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fcd35912-11fb-48e6-b20a-32e7aeae0e6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:54.282437 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:54.288106 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fcd35912-11fb-48e6-b20a-32e7aeae0e6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:54.288628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fcd35912-11fb-48e6-b20a-32e7aeae0e6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:54.289238 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fcd35912-11fb-48e6-b20a-32e7aeae0e6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:54.290156 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fcd35912-11fb-48e6-b20a-32e7aeae0e6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:54.290808 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fcd35912-11fb-48e6-b20a-32e7aeae0e6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:54.291414 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fcd35912-11fb-48e6-b20a-32e7aeae0e6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:54.291592 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-7c5e37c1-380b-4e8d-9630-0fd5701cf387 req-3777a193-b991-4ad0-9b16-6d045577947e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d1714b-1531-428f-a205-e42cedf76d9b", "name": "network-vif-unplugged", "status": "completed", "tag": "629e65e7-9a31-4acf-8a66-2220e5591487"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:54.323514 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-7c5e37c1-380b-4e8d-9630-0fd5701cf387 req-3777a193-b991-4ad0-9b16-6d045577947e service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:54.324011 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-7c5e37c1-380b-4e8d-9630-0fd5701cf387 req-3777a193-b991-4ad0-9b16-6d045577947e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:54.325818 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-7c5e37c1-380b-4e8d-9630-0fd5701cf387 req-3777a193-b991-4ad0-9b16-6d045577947e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:54.338872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-7c5e37c1-380b-4e8d-9630-0fd5701cf387 req-3777a193-b991-4ad0-9b16-6d045577947e service nova] Creating event network-vif-unplugged:629e65e7-9a31-4acf-8a66-2220e5591487 for instance 09d1714b-1531-428f-a205-e42cedf76d9b on hv-cinder-85220 Aug 24 16:57:54.343995 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-7c5e37c1-380b-4e8d-9630-0fd5701cf387 req-3777a193-b991-4ad0-9b16-6d045577947e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056067 Aug 24 16:57:54.344961 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 421/847] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:57:54.544752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fcd35912-11fb-48e6-b20a-32e7aeae0e6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:54.549272 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:54.557366 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fcd35912-11fb-48e6-b20a-32e7aeae0e6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:54.565425 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fcd35912-11fb-48e6-b20a-32e7aeae0e6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:54.566733 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fcd35912-11fb-48e6-b20a-32e7aeae0e6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1721 microversion: 2.20 time: 0.292268 Aug 24 16:57:54.567568 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 427/848] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:54 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:55.592274 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-493133c6-24b3-419c-ab58-992038fe3a49 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:55.593134 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-493133c6-24b3-419c-ab58-992038fe3a49 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:55.599876 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-493133c6-24b3-419c-ab58-992038fe3a49 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:55.600364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-493133c6-24b3-419c-ab58-992038fe3a49 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:55.600831 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-493133c6-24b3-419c-ab58-992038fe3a49 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:55.601534 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-493133c6-24b3-419c-ab58-992038fe3a49 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:55.601993 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-493133c6-24b3-419c-ab58-992038fe3a49 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:55.602423 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-493133c6-24b3-419c-ab58-992038fe3a49 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:55.937209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-493133c6-24b3-419c-ab58-992038fe3a49 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:55.945633 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-493133c6-24b3-419c-ab58-992038fe3a49 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:55.948134 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-493133c6-24b3-419c-ab58-992038fe3a49 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:55.949379 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-493133c6-24b3-419c-ab58-992038fe3a49 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1664 microversion: 2.20 time: 0.361994 Aug 24 16:57:55.949944 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 422/849] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:55 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1664 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:55.972856 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-00111504-2ffd-41e9-a065-a9d7b3333555 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab567b2f-a31c-496c-a86a-a91b637ff3cb"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:55.975234 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-00111504-2ffd-41e9-a065-a9d7b3333555 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:55.984226 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-00111504-2ffd-41e9-a065-a9d7b3333555 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:55.987976 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-00111504-2ffd-41e9-a065-a9d7b3333555 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:55.988921 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-00111504-2ffd-41e9-a065-a9d7b3333555 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:55.989814 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-00111504-2ffd-41e9-a065-a9d7b3333555 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:55.990462 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-00111504-2ffd-41e9-a065-a9d7b3333555 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:55.990890 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-00111504-2ffd-41e9-a065-a9d7b3333555 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:56.666459 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1343744898", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "networks": [{"uuid": "9d6175e9-e56e-4df9-8b44-e9e9bea37004"}]}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:56.722520 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.network.neutron [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] validate_networks() for [('9d6175e9-e56e-4df9-8b44-e9e9bea37004', None, None, None, None, None)] {{(pid=127715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:57:57.095751 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Flavor limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:57:57.096285 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Image limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:57:57.096931 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Flavor pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:57:57.097431 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Image pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:57:57.097861 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:57:57.107183 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:57.107707 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:57.108351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:57.109153 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:57.109612 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:57.110042 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:57.110176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-00111504-2ffd-41e9-a065-a9d7b3333555 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "POST /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.141988 Aug 24 16:57:57.111067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 428/850] 10.222.0.70 () {62 vars in 1364 bytes} [Wed Aug 24 16:57:55 2022] POST /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/os-volume_attachments => generated 188 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:57:57.128266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Getting quotas for project 1088b1d454684ca5be800a99d4e26304. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:57:57.132718 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Getting quotas for user d715cc7828f847529f795f356a8ac16b and project 1088b1d454684ca5be800a99d4e26304. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:57:57.146036 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Going to run 1 instances... {{(pid=127715) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:57:57.148520 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:57:57.239816 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8ed303e9-1289-48bc-88b5-53e1df81f2f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:57.240323 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8ed303e9-1289-48bc-88b5-53e1df81f2f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:57.247534 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ed303e9-1289-48bc-88b5-53e1df81f2f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:57.248027 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ed303e9-1289-48bc-88b5-53e1df81f2f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:57.248496 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ed303e9-1289-48bc-88b5-53e1df81f2f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:57.249198 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ed303e9-1289-48bc-88b5-53e1df81f2f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:57.249653 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ed303e9-1289-48bc-88b5-53e1df81f2f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:57.250078 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ed303e9-1289-48bc-88b5-53e1df81f2f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:57.332553 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-459d484d-febf-43d3-86da-45f7b339f6c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669451 Aug 24 16:57:57.333523 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 423/851] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:57:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:57:57.350818 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e7bdb06c-c038-42df-bd8a-bfc62af99ce2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:57.350818 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e7bdb06c-c038-42df-bd8a-bfc62af99ce2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:57.410394 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e7bdb06c-c038-42df-bd8a-bfc62af99ce2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:57.419269 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e7bdb06c-c038-42df-bd8a-bfc62af99ce2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1219 microversion: 2.1 time: 0.075998 Aug 24 16:57:57.433691 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 424/852] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:57 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:57.945645 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8ed303e9-1289-48bc-88b5-53e1df81f2f5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "DELETE /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/os-volume_attachments/ab567b2f-a31c-496c-a86a-a91b637ff3cb" status: 202 len: 0 microversion: 2.20 time: 0.709712 Aug 24 16:57:57.946162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 429/853] 10.222.0.70 () {60 vars in 1457 bytes} [Wed Aug 24 16:57:57 2022] DELETE /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/os-volume_attachments/ab567b2f-a31c-496c-a86a-a91b637ff3cb => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:57:58.023535 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e2b43df0-392d-4ffe-b6ef-98673807f535 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:57:58.025335 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e2b43df0-392d-4ffe-b6ef-98673807f535 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:58.032554 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e2b43df0-392d-4ffe-b6ef-98673807f535 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:58.033282 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e2b43df0-392d-4ffe-b6ef-98673807f535 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:58.033882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e2b43df0-392d-4ffe-b6ef-98673807f535 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:58.034607 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e2b43df0-392d-4ffe-b6ef-98673807f535 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:58.035067 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e2b43df0-392d-4ffe-b6ef-98673807f535 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:58.035497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e2b43df0-392d-4ffe-b6ef-98673807f535 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:58.071922 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e2b43df0-392d-4ffe-b6ef-98673807f535 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127715) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 16:57:58.439217 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-04565f70-5669-4e54-88e5-63bac0c37b9a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:58.439882 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-04565f70-5669-4e54-88e5-63bac0c37b9a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:58.489813 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e2b43df0-392d-4ffe-b6ef-98673807f535 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "POST /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/action" status: 202 len: 0 microversion: 2.20 time: 0.470716 Aug 24 16:57:58.496819 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 425/854] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Aug 24 16:57:58 2022] POST /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:58.497582 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-04565f70-5669-4e54-88e5-63bac0c37b9a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:58.505527 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-04565f70-5669-4e54-88e5-63bac0c37b9a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1219 microversion: 2.1 time: 0.069819 Aug 24 16:57:58.506694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 430/855] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:58 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:57:58.507373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a49d1f44-c88c-4002-8078-c564b2c58860 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:58.508310 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a49d1f44-c88c-4002-8078-c564b2c58860 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:58.519542 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a49d1f44-c88c-4002-8078-c564b2c58860 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:58.520033 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a49d1f44-c88c-4002-8078-c564b2c58860 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:58.520503 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a49d1f44-c88c-4002-8078-c564b2c58860 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:58.521214 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a49d1f44-c88c-4002-8078-c564b2c58860 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:58.521665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a49d1f44-c88c-4002-8078-c564b2c58860 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:58.522086 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a49d1f44-c88c-4002-8078-c564b2c58860 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:58.678859 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a49d1f44-c88c-4002-8078-c564b2c58860 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:58.688440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a49d1f44-c88c-4002-8078-c564b2c58860 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:58.693822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a49d1f44-c88c-4002-8078-c564b2c58860 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:58.693822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a49d1f44-c88c-4002-8078-c564b2c58860 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1672 microversion: 2.20 time: 0.192835 Aug 24 16:57:58.693822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 426/856] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:58 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:57:59.527629 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6efe4f38-88e4-4845-b4c9-b42b60785667 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:59.528255 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6efe4f38-88e4-4845-b4c9-b42b60785667 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:59.534773 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6efe4f38-88e4-4845-b4c9-b42b60785667 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:59.535441 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6efe4f38-88e4-4845-b4c9-b42b60785667 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:59.536571 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6efe4f38-88e4-4845-b4c9-b42b60785667 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:59.536571 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6efe4f38-88e4-4845-b4c9-b42b60785667 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:59.537046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6efe4f38-88e4-4845-b4c9-b42b60785667 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:59.537472 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6efe4f38-88e4-4845-b4c9-b42b60785667 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:59.601590 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6efe4f38-88e4-4845-b4c9-b42b60785667 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:57:59.611977 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6efe4f38-88e4-4845-b4c9-b42b60785667 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1271 microversion: 2.1 time: 0.088722 Aug 24 16:57:59.612621 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 431/857] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:57:59 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:59.715295 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a3ff2d7c-7183-4aaf-8c3e-1665da4e19d9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:57:59.715846 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a3ff2d7c-7183-4aaf-8c3e-1665da4e19d9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:57:59.722317 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a3ff2d7c-7183-4aaf-8c3e-1665da4e19d9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:59.724557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a3ff2d7c-7183-4aaf-8c3e-1665da4e19d9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:59.724557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a3ff2d7c-7183-4aaf-8c3e-1665da4e19d9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:57:59.724557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a3ff2d7c-7183-4aaf-8c3e-1665da4e19d9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:57:59.724557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a3ff2d7c-7183-4aaf-8c3e-1665da4e19d9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:57:59.724992 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a3ff2d7c-7183-4aaf-8c3e-1665da4e19d9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:00.116808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a3ff2d7c-7183-4aaf-8c3e-1665da4e19d9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:00.122672 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:00.129160 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a3ff2d7c-7183-4aaf-8c3e-1665da4e19d9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:00.131587 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a3ff2d7c-7183-4aaf-8c3e-1665da4e19d9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:00.133216 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a3ff2d7c-7183-4aaf-8c3e-1665da4e19d9 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1672 microversion: 2.20 time: 0.422348 Aug 24 16:58:00.134871 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 427/858] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:57:59 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1672 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:00.632716 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a854244c-9733-4b33-b156-926409897c00 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:00.633336 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a854244c-9733-4b33-b156-926409897c00 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:00.639895 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a854244c-9733-4b33-b156-926409897c00 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:00.654732 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a854244c-9733-4b33-b156-926409897c00 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:00.654732 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a854244c-9733-4b33-b156-926409897c00 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:00.654732 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a854244c-9733-4b33-b156-926409897c00 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:00.654732 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a854244c-9733-4b33-b156-926409897c00 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:00.655176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a854244c-9733-4b33-b156-926409897c00 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:00.722150 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a854244c-9733-4b33-b156-926409897c00 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:00.730584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a854244c-9733-4b33-b156-926409897c00 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1277 microversion: 2.1 time: 0.102082 Aug 24 16:58:00.731158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 432/859] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:00 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:01.159672 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2a8eaaa3-25c7-4007-85f7-429301a6e429 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:01.160265 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2a8eaaa3-25c7-4007-85f7-429301a6e429 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:01.163726 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:01.168784 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a8eaaa3-25c7-4007-85f7-429301a6e429 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:01.169440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a8eaaa3-25c7-4007-85f7-429301a6e429 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:01.169894 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a8eaaa3-25c7-4007-85f7-429301a6e429 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:01.170603 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a8eaaa3-25c7-4007-85f7-429301a6e429 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:01.171068 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a8eaaa3-25c7-4007-85f7-429301a6e429 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:01.171504 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a8eaaa3-25c7-4007-85f7-429301a6e429 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:01.313314 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2a8eaaa3-25c7-4007-85f7-429301a6e429 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:01.322140 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2a8eaaa3-25c7-4007-85f7-429301a6e429 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:01.323595 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2a8eaaa3-25c7-4007-85f7-429301a6e429 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:01.324798 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2a8eaaa3-25c7-4007-85f7-429301a6e429 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.169455 Aug 24 16:58:01.325340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 428/860] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:01 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:01.754045 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b30a183a-0b0f-4ee8-82d4-6515564e52b0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:01.755292 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b30a183a-0b0f-4ee8-82d4-6515564e52b0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:01.763791 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b30a183a-0b0f-4ee8-82d4-6515564e52b0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:01.764499 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b30a183a-0b0f-4ee8-82d4-6515564e52b0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:01.765030 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b30a183a-0b0f-4ee8-82d4-6515564e52b0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:01.765841 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b30a183a-0b0f-4ee8-82d4-6515564e52b0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:01.766403 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b30a183a-0b0f-4ee8-82d4-6515564e52b0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:01.766923 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b30a183a-0b0f-4ee8-82d4-6515564e52b0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:01.925035 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b30a183a-0b0f-4ee8-82d4-6515564e52b0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:01.933709 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b30a183a-0b0f-4ee8-82d4-6515564e52b0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.183717 Aug 24 16:58:01.934193 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 433/861] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:01 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:58:02.348584 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c0bb0745-ebb1-4337-b2f1-9ac2e99d3c22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:02.349373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c0bb0745-ebb1-4337-b2f1-9ac2e99d3c22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:02.357332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c0bb0745-ebb1-4337-b2f1-9ac2e99d3c22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:02.358676 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c0bb0745-ebb1-4337-b2f1-9ac2e99d3c22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:02.358676 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c0bb0745-ebb1-4337-b2f1-9ac2e99d3c22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:02.358939 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c0bb0745-ebb1-4337-b2f1-9ac2e99d3c22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:02.359372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c0bb0745-ebb1-4337-b2f1-9ac2e99d3c22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:02.359796 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c0bb0745-ebb1-4337-b2f1-9ac2e99d3c22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:02.504125 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c0bb0745-ebb1-4337-b2f1-9ac2e99d3c22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:02.514110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c0bb0745-ebb1-4337-b2f1-9ac2e99d3c22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:02.515690 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c0bb0745-ebb1-4337-b2f1-9ac2e99d3c22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:02.516982 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c0bb0745-ebb1-4337-b2f1-9ac2e99d3c22 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.172323 Aug 24 16:58:02.517540 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 429/862] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:02 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:02.889870 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-5cf7b56a-bace-4055-8b9e-ace0f31c909d req-43a13e60-41c8-41ea-820d-ac84385aa771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dedced4a-76f1-477b-8db0-19cef618a229", "tag": "898ca7b8-cd5f-448f-bb25-43f8b1ecfb52"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:58:02.901625 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-5cf7b56a-bace-4055-8b9e-ace0f31c909d req-43a13e60-41c8-41ea-820d-ac84385aa771 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:02.902310 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-5cf7b56a-bace-4055-8b9e-ace0f31c909d req-43a13e60-41c8-41ea-820d-ac84385aa771 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:02.903077 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-5cf7b56a-bace-4055-8b9e-ace0f31c909d req-43a13e60-41c8-41ea-820d-ac84385aa771 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:02.922801 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-5cf7b56a-bace-4055-8b9e-ace0f31c909d req-43a13e60-41c8-41ea-820d-ac84385aa771 service nova] Creating event network-changed:898ca7b8-cd5f-448f-bb25-43f8b1ecfb52 for instance dedced4a-76f1-477b-8db0-19cef618a229 on hv-cinder-85220 Aug 24 16:58:02.928737 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-5cf7b56a-bace-4055-8b9e-ace0f31c909d req-43a13e60-41c8-41ea-820d-ac84385aa771 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042973 Aug 24 16:58:02.929572 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 434/863] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:58:02.955776 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-87826e90-155f-42c4-b713-b1c278ddd638 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:02.956420 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-87826e90-155f-42c4-b713-b1c278ddd638 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:02.962486 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-87826e90-155f-42c4-b713-b1c278ddd638 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:02.963173 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-87826e90-155f-42c4-b713-b1c278ddd638 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:02.963779 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-87826e90-155f-42c4-b713-b1c278ddd638 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:02.964974 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-87826e90-155f-42c4-b713-b1c278ddd638 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:02.965644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-87826e90-155f-42c4-b713-b1c278ddd638 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:02.966613 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-87826e90-155f-42c4-b713-b1c278ddd638 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:03.177029 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-87826e90-155f-42c4-b713-b1c278ddd638 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:03.188774 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-87826e90-155f-42c4-b713-b1c278ddd638 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.237565 Aug 24 16:58:03.189999 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 430/864] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:02 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:58:03.541277 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7c244b0d-3801-4786-bcc7-4da333b6670a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:03.542279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7c244b0d-3801-4786-bcc7-4da333b6670a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:03.553407 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c244b0d-3801-4786-bcc7-4da333b6670a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:03.553407 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c244b0d-3801-4786-bcc7-4da333b6670a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:03.553407 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c244b0d-3801-4786-bcc7-4da333b6670a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:03.553407 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c244b0d-3801-4786-bcc7-4da333b6670a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:03.553788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c244b0d-3801-4786-bcc7-4da333b6670a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:03.553788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c244b0d-3801-4786-bcc7-4da333b6670a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:03.714408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7c244b0d-3801-4786-bcc7-4da333b6670a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:03.733438 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7c244b0d-3801-4786-bcc7-4da333b6670a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:03.735847 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7c244b0d-3801-4786-bcc7-4da333b6670a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:03.738970 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7c244b0d-3801-4786-bcc7-4da333b6670a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.202220 Aug 24 16:58:03.740204 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 435/865] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:03 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:04.210649 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-82459574-583c-4678-bdb9-b69c6d5a7af8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:04.211435 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-82459574-583c-4678-bdb9-b69c6d5a7af8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:04.219443 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-82459574-583c-4678-bdb9-b69c6d5a7af8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:04.220314 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-82459574-583c-4678-bdb9-b69c6d5a7af8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:04.220889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-82459574-583c-4678-bdb9-b69c6d5a7af8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:04.221893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-82459574-583c-4678-bdb9-b69c6d5a7af8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:04.222362 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-82459574-583c-4678-bdb9-b69c6d5a7af8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:04.222792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-82459574-583c-4678-bdb9-b69c6d5a7af8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:04.413182 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-82459574-583c-4678-bdb9-b69c6d5a7af8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:04.421325 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-82459574-583c-4678-bdb9-b69c6d5a7af8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.214723 Aug 24 16:58:04.422833 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 431/866] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:04 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:04.765357 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4c1bf922-08a9-45a1-b853-2bf5da3fec14 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:04.767417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4c1bf922-08a9-45a1-b853-2bf5da3fec14 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:04.775216 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c1bf922-08a9-45a1-b853-2bf5da3fec14 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:04.776022 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c1bf922-08a9-45a1-b853-2bf5da3fec14 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:04.776727 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c1bf922-08a9-45a1-b853-2bf5da3fec14 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:04.777821 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c1bf922-08a9-45a1-b853-2bf5da3fec14 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:04.778501 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c1bf922-08a9-45a1-b853-2bf5da3fec14 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:04.779147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c1bf922-08a9-45a1-b853-2bf5da3fec14 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:04.955947 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4c1bf922-08a9-45a1-b853-2bf5da3fec14 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:04.964909 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4c1bf922-08a9-45a1-b853-2bf5da3fec14 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:04.978446 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4c1bf922-08a9-45a1-b853-2bf5da3fec14 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:04.978446 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4c1bf922-08a9-45a1-b853-2bf5da3fec14 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.207049 Aug 24 16:58:04.978446 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 436/867] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:04 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:05.443281 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-16ce8cfd-3397-4643-bd01-a3d39e846cf4 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:05.443989 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-16ce8cfd-3397-4643-bd01-a3d39e846cf4 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:05.451715 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-16ce8cfd-3397-4643-bd01-a3d39e846cf4 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:05.452305 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-16ce8cfd-3397-4643-bd01-a3d39e846cf4 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:05.452866 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-16ce8cfd-3397-4643-bd01-a3d39e846cf4 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:05.453583 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-16ce8cfd-3397-4643-bd01-a3d39e846cf4 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:05.454041 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-16ce8cfd-3397-4643-bd01-a3d39e846cf4 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:05.454465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-16ce8cfd-3397-4643-bd01-a3d39e846cf4 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:05.624334 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-16ce8cfd-3397-4643-bd01-a3d39e846cf4 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:05.632871 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-16ce8cfd-3397-4643-bd01-a3d39e846cf4 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.193906 Aug 24 16:58:05.633494 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 432/868] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:05 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:05.990976 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1f46c1ec-e8d6-4904-8d4a-8536747a2ac0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:05.991565 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1f46c1ec-e8d6-4904-8d4a-8536747a2ac0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:05.999309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f46c1ec-e8d6-4904-8d4a-8536747a2ac0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:05.999793 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f46c1ec-e8d6-4904-8d4a-8536747a2ac0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:06.000432 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f46c1ec-e8d6-4904-8d4a-8536747a2ac0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:06.001140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f46c1ec-e8d6-4904-8d4a-8536747a2ac0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:06.001645 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f46c1ec-e8d6-4904-8d4a-8536747a2ac0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:06.002096 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f46c1ec-e8d6-4904-8d4a-8536747a2ac0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:06.210641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1f46c1ec-e8d6-4904-8d4a-8536747a2ac0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:06.219562 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1f46c1ec-e8d6-4904-8d4a-8536747a2ac0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:06.227950 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1f46c1ec-e8d6-4904-8d4a-8536747a2ac0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:06.227950 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1f46c1ec-e8d6-4904-8d4a-8536747a2ac0 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.235863 Aug 24 16:58:06.227950 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 437/869] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:05 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:06.654073 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6fd64bbc-5638-4529-b7f7-3cd95a5d5ca9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:06.662359 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6fd64bbc-5638-4529-b7f7-3cd95a5d5ca9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:06.662359 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6fd64bbc-5638-4529-b7f7-3cd95a5d5ca9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:06.662595 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6fd64bbc-5638-4529-b7f7-3cd95a5d5ca9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:06.662909 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6fd64bbc-5638-4529-b7f7-3cd95a5d5ca9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:06.663978 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6fd64bbc-5638-4529-b7f7-3cd95a5d5ca9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:06.665254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6fd64bbc-5638-4529-b7f7-3cd95a5d5ca9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:06.665924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6fd64bbc-5638-4529-b7f7-3cd95a5d5ca9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:06.851692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6fd64bbc-5638-4529-b7f7-3cd95a5d5ca9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:06.860822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6fd64bbc-5638-4529-b7f7-3cd95a5d5ca9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.210495 Aug 24 16:58:06.861751 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 433/870] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:06 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:07.248973 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1ca9cb79-1fd6-4445-8925-d4d85f71fa43 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:07.251289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1ca9cb79-1fd6-4445-8925-d4d85f71fa43 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:07.261701 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ca9cb79-1fd6-4445-8925-d4d85f71fa43 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:07.262458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ca9cb79-1fd6-4445-8925-d4d85f71fa43 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:07.262898 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ca9cb79-1fd6-4445-8925-d4d85f71fa43 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:07.263629 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ca9cb79-1fd6-4445-8925-d4d85f71fa43 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:07.264085 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ca9cb79-1fd6-4445-8925-d4d85f71fa43 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:07.264609 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ca9cb79-1fd6-4445-8925-d4d85f71fa43 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:07.410781 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1ca9cb79-1fd6-4445-8925-d4d85f71fa43 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:07.420455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1ca9cb79-1fd6-4445-8925-d4d85f71fa43 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:07.421976 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1ca9cb79-1fd6-4445-8925-d4d85f71fa43 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:07.423164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1ca9cb79-1fd6-4445-8925-d4d85f71fa43 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.178196 Aug 24 16:58:07.423729 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 438/871] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:07 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:08.041466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d44c71de-c04b-45bf-93e5-3f905b33cd8e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:08.042148 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d44c71de-c04b-45bf-93e5-3f905b33cd8e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:08.050102 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:08.058409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=8 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:08.058409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d44c71de-c04b-45bf-93e5-3f905b33cd8e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:08.058409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d44c71de-c04b-45bf-93e5-3f905b33cd8e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:08.058409 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d44c71de-c04b-45bf-93e5-3f905b33cd8e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:08.058813 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d44c71de-c04b-45bf-93e5-3f905b33cd8e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:08.058813 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d44c71de-c04b-45bf-93e5-3f905b33cd8e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:08.058813 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d44c71de-c04b-45bf-93e5-3f905b33cd8e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:08.273896 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d44c71de-c04b-45bf-93e5-3f905b33cd8e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:08.282969 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d44c71de-c04b-45bf-93e5-3f905b33cd8e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.246089 Aug 24 16:58:08.283818 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 434/872] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:08 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:08.449923 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-27a14b9c-bbe8-44e5-ae89-034673c2632b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:08.451237 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-27a14b9c-bbe8-44e5-ae89-034673c2632b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:08.479174 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27a14b9c-bbe8-44e5-ae89-034673c2632b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:08.480261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27a14b9c-bbe8-44e5-ae89-034673c2632b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:08.480952 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27a14b9c-bbe8-44e5-ae89-034673c2632b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:08.481978 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27a14b9c-bbe8-44e5-ae89-034673c2632b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:08.482657 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27a14b9c-bbe8-44e5-ae89-034673c2632b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:08.483310 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27a14b9c-bbe8-44e5-ae89-034673c2632b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:08.505802 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:08.833874 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-27a14b9c-bbe8-44e5-ae89-034673c2632b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:08.845873 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-27a14b9c-bbe8-44e5-ae89-034673c2632b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:08.856569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-27a14b9c-bbe8-44e5-ae89-034673c2632b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:08.856569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-27a14b9c-bbe8-44e5-ae89-034673c2632b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.403967 Aug 24 16:58:08.856569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 439/873] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:08 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:09.313759 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ecd639f7-2ad2-4e52-8385-07a7d8def32d tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:09.315097 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ecd639f7-2ad2-4e52-8385-07a7d8def32d tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:09.329605 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ecd639f7-2ad2-4e52-8385-07a7d8def32d tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:09.330531 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ecd639f7-2ad2-4e52-8385-07a7d8def32d tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:09.331142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ecd639f7-2ad2-4e52-8385-07a7d8def32d tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:09.332036 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ecd639f7-2ad2-4e52-8385-07a7d8def32d tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:09.332734 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ecd639f7-2ad2-4e52-8385-07a7d8def32d tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:09.333323 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ecd639f7-2ad2-4e52-8385-07a7d8def32d tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:09.527011 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ecd639f7-2ad2-4e52-8385-07a7d8def32d tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:09.530464 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ecd639f7-2ad2-4e52-8385-07a7d8def32d tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.220544 Aug 24 16:58:09.531297 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 435/874] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:09 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:09.873761 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-41494b8f-efd8-49a3-aa7d-b9b2d6eb5617 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:09.875335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-41494b8f-efd8-49a3-aa7d-b9b2d6eb5617 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:09.882387 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-41494b8f-efd8-49a3-aa7d-b9b2d6eb5617 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:09.883124 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-41494b8f-efd8-49a3-aa7d-b9b2d6eb5617 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:09.884258 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-41494b8f-efd8-49a3-aa7d-b9b2d6eb5617 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:09.885469 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-41494b8f-efd8-49a3-aa7d-b9b2d6eb5617 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:09.886098 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-41494b8f-efd8-49a3-aa7d-b9b2d6eb5617 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:09.886686 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-41494b8f-efd8-49a3-aa7d-b9b2d6eb5617 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:10.131365 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-41494b8f-efd8-49a3-aa7d-b9b2d6eb5617 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:10.147479 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-41494b8f-efd8-49a3-aa7d-b9b2d6eb5617 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:10.149448 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-41494b8f-efd8-49a3-aa7d-b9b2d6eb5617 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:10.151210 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-41494b8f-efd8-49a3-aa7d-b9b2d6eb5617 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.281462 Aug 24 16:58:10.152006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 440/875] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:09 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:10.554768 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0019d725-8e4c-4279-8a72-49e5d2086694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:10.556090 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0019d725-8e4c-4279-8a72-49e5d2086694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:10.572453 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0019d725-8e4c-4279-8a72-49e5d2086694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:10.573001 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0019d725-8e4c-4279-8a72-49e5d2086694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:10.573464 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0019d725-8e4c-4279-8a72-49e5d2086694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:10.574231 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0019d725-8e4c-4279-8a72-49e5d2086694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:10.574702 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0019d725-8e4c-4279-8a72-49e5d2086694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:10.575138 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0019d725-8e4c-4279-8a72-49e5d2086694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:10.768494 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0019d725-8e4c-4279-8a72-49e5d2086694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:10.777320 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0019d725-8e4c-4279-8a72-49e5d2086694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.228035 Aug 24 16:58:10.781196 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 436/876] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:10 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:11.179008 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4137edab-044f-4376-a315-eec1e38cb389 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:11.179783 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4137edab-044f-4376-a315-eec1e38cb389 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:11.189860 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4137edab-044f-4376-a315-eec1e38cb389 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:11.189860 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4137edab-044f-4376-a315-eec1e38cb389 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:11.189860 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4137edab-044f-4376-a315-eec1e38cb389 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:11.190264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4137edab-044f-4376-a315-eec1e38cb389 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:11.190904 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4137edab-044f-4376-a315-eec1e38cb389 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:11.191502 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4137edab-044f-4376-a315-eec1e38cb389 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:11.198080 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:11.370125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4137edab-044f-4376-a315-eec1e38cb389 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:11.380591 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4137edab-044f-4376-a315-eec1e38cb389 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:11.383097 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4137edab-044f-4376-a315-eec1e38cb389 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:11.385272 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4137edab-044f-4376-a315-eec1e38cb389 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.212151 Aug 24 16:58:11.386038 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 441/877] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:11 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:11.806662 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-987ff6c3-83b6-4ebb-b226-9f4fccdd0a3c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:11.808599 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-987ff6c3-83b6-4ebb-b226-9f4fccdd0a3c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:11.820417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-987ff6c3-83b6-4ebb-b226-9f4fccdd0a3c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:11.821345 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-987ff6c3-83b6-4ebb-b226-9f4fccdd0a3c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:11.821952 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-987ff6c3-83b6-4ebb-b226-9f4fccdd0a3c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:11.822856 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-987ff6c3-83b6-4ebb-b226-9f4fccdd0a3c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:11.823824 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-987ff6c3-83b6-4ebb-b226-9f4fccdd0a3c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:11.824262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-987ff6c3-83b6-4ebb-b226-9f4fccdd0a3c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:11.968939 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-987ff6c3-83b6-4ebb-b226-9f4fccdd0a3c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:11.977515 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-987ff6c3-83b6-4ebb-b226-9f4fccdd0a3c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.174932 Aug 24 16:58:11.978100 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 437/878] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:11 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:12.408698 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-651add75-b2fd-4f02-9974-1b566e3b6542 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:12.409324 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-651add75-b2fd-4f02-9974-1b566e3b6542 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:12.416710 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-651add75-b2fd-4f02-9974-1b566e3b6542 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:12.417218 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-651add75-b2fd-4f02-9974-1b566e3b6542 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:12.417622 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-651add75-b2fd-4f02-9974-1b566e3b6542 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:12.418308 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-651add75-b2fd-4f02-9974-1b566e3b6542 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:12.418753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-651add75-b2fd-4f02-9974-1b566e3b6542 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:12.419169 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-651add75-b2fd-4f02-9974-1b566e3b6542 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:12.554016 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-651add75-b2fd-4f02-9974-1b566e3b6542 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:12.566315 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-651add75-b2fd-4f02-9974-1b566e3b6542 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:12.569643 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-651add75-b2fd-4f02-9974-1b566e3b6542 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:12.572165 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-651add75-b2fd-4f02-9974-1b566e3b6542 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.166421 Aug 24 16:58:12.572778 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 442/879] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:12 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:12.998979 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fe7af364-bcd1-4019-beea-3f86043259ac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:13.000210 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fe7af364-bcd1-4019-beea-3f86043259ac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:13.008165 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe7af364-bcd1-4019-beea-3f86043259ac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:13.009646 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe7af364-bcd1-4019-beea-3f86043259ac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:13.010268 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe7af364-bcd1-4019-beea-3f86043259ac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:13.011160 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe7af364-bcd1-4019-beea-3f86043259ac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:13.011785 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe7af364-bcd1-4019-beea-3f86043259ac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:13.012427 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fe7af364-bcd1-4019-beea-3f86043259ac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:13.164297 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fe7af364-bcd1-4019-beea-3f86043259ac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:13.174593 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fe7af364-bcd1-4019-beea-3f86043259ac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.179263 Aug 24 16:58:13.175938 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 438/880] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:12 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:13.597229 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-85792556-a4c4-44fd-a4da-ad6f5ab9e52d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:13.598496 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-85792556-a4c4-44fd-a4da-ad6f5ab9e52d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:13.606444 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85792556-a4c4-44fd-a4da-ad6f5ab9e52d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:13.607251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85792556-a4c4-44fd-a4da-ad6f5ab9e52d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:13.607899 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85792556-a4c4-44fd-a4da-ad6f5ab9e52d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:13.608874 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85792556-a4c4-44fd-a4da-ad6f5ab9e52d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:13.609633 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85792556-a4c4-44fd-a4da-ad6f5ab9e52d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:13.610160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85792556-a4c4-44fd-a4da-ad6f5ab9e52d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:13.802658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-85792556-a4c4-44fd-a4da-ad6f5ab9e52d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:13.811230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-85792556-a4c4-44fd-a4da-ad6f5ab9e52d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:13.813024 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-85792556-a4c4-44fd-a4da-ad6f5ab9e52d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:13.814433 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-85792556-a4c4-44fd-a4da-ad6f5ab9e52d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.222918 Aug 24 16:58:13.815112 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 443/881] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:13 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:14.198939 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7faae0e2-6aee-456a-acba-20c9aa720dbe tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:14.200349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7faae0e2-6aee-456a-acba-20c9aa720dbe tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:14.214987 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7faae0e2-6aee-456a-acba-20c9aa720dbe tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:14.216251 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7faae0e2-6aee-456a-acba-20c9aa720dbe tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:14.217496 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7faae0e2-6aee-456a-acba-20c9aa720dbe tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:14.219060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7faae0e2-6aee-456a-acba-20c9aa720dbe tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:14.220095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7faae0e2-6aee-456a-acba-20c9aa720dbe tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:14.221195 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7faae0e2-6aee-456a-acba-20c9aa720dbe tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:14.739760 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7faae0e2-6aee-456a-acba-20c9aa720dbe tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:14.755522 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7faae0e2-6aee-456a-acba-20c9aa720dbe tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.563174 Aug 24 16:58:14.769227 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 439/882] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:14 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:14.837480 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b2e569dc-0212-4aa4-9044-c7c0db4b3c23 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:14.838850 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b2e569dc-0212-4aa4-9044-c7c0db4b3c23 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:14.846102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e569dc-0212-4aa4-9044-c7c0db4b3c23 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:14.846725 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e569dc-0212-4aa4-9044-c7c0db4b3c23 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:14.847170 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e569dc-0212-4aa4-9044-c7c0db4b3c23 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:14.852647 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e569dc-0212-4aa4-9044-c7c0db4b3c23 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:14.852647 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e569dc-0212-4aa4-9044-c7c0db4b3c23 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:14.852647 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e569dc-0212-4aa4-9044-c7c0db4b3c23 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:15.134943 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2e569dc-0212-4aa4-9044-c7c0db4b3c23 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:15.148083 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2e569dc-0212-4aa4-9044-c7c0db4b3c23 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:15.150444 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2e569dc-0212-4aa4-9044-c7c0db4b3c23 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:15.152645 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b2e569dc-0212-4aa4-9044-c7c0db4b3c23 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.319041 Aug 24 16:58:15.153871 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 444/883] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:14 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:15.781064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1a4b033c-ca3d-4d71-87cf-d8a7ae05c7ad tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:15.781682 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1a4b033c-ca3d-4d71-87cf-d8a7ae05c7ad tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:15.788967 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a4b033c-ca3d-4d71-87cf-d8a7ae05c7ad tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:15.790094 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a4b033c-ca3d-4d71-87cf-d8a7ae05c7ad tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:15.790919 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a4b033c-ca3d-4d71-87cf-d8a7ae05c7ad tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:15.792524 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a4b033c-ca3d-4d71-87cf-d8a7ae05c7ad tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:15.793200 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a4b033c-ca3d-4d71-87cf-d8a7ae05c7ad tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:15.795032 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a4b033c-ca3d-4d71-87cf-d8a7ae05c7ad tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:16.021091 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1a4b033c-ca3d-4d71-87cf-d8a7ae05c7ad tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:16.035229 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1a4b033c-ca3d-4d71-87cf-d8a7ae05c7ad tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.257132 Aug 24 16:58:16.036191 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 440/884] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:15 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:16.176763 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c00e84d0-3029-4922-ab01-27eec547e9e7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:16.177611 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c00e84d0-3029-4922-ab01-27eec547e9e7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:16.187185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c00e84d0-3029-4922-ab01-27eec547e9e7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:16.187942 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c00e84d0-3029-4922-ab01-27eec547e9e7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:16.188614 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c00e84d0-3029-4922-ab01-27eec547e9e7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:16.189549 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c00e84d0-3029-4922-ab01-27eec547e9e7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:16.190131 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c00e84d0-3029-4922-ab01-27eec547e9e7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:16.190657 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c00e84d0-3029-4922-ab01-27eec547e9e7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:16.473122 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c00e84d0-3029-4922-ab01-27eec547e9e7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:16.482721 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c00e84d0-3029-4922-ab01-27eec547e9e7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:16.486662 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c00e84d0-3029-4922-ab01-27eec547e9e7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:16.488114 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c00e84d0-3029-4922-ab01-27eec547e9e7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.315368 Aug 24 16:58:16.503229 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 445/885] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:16 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:17.058219 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ceff62fc-7e99-4252-814c-e9592f7ff677 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:17.059472 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ceff62fc-7e99-4252-814c-e9592f7ff677 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:17.065914 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ceff62fc-7e99-4252-814c-e9592f7ff677 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:17.066630 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ceff62fc-7e99-4252-814c-e9592f7ff677 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:17.067060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ceff62fc-7e99-4252-814c-e9592f7ff677 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:17.067949 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ceff62fc-7e99-4252-814c-e9592f7ff677 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:17.068421 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ceff62fc-7e99-4252-814c-e9592f7ff677 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:17.069002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ceff62fc-7e99-4252-814c-e9592f7ff677 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:17.261297 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ceff62fc-7e99-4252-814c-e9592f7ff677 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:17.269540 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ceff62fc-7e99-4252-814c-e9592f7ff677 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.215765 Aug 24 16:58:17.270112 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 441/886] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:17 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:58:17.515301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-17cd1982-03d9-4101-b36f-916e0fb3c219 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:17.516463 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-17cd1982-03d9-4101-b36f-916e0fb3c219 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:17.526167 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17cd1982-03d9-4101-b36f-916e0fb3c219 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:17.526654 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17cd1982-03d9-4101-b36f-916e0fb3c219 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:17.527313 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17cd1982-03d9-4101-b36f-916e0fb3c219 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:17.528184 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17cd1982-03d9-4101-b36f-916e0fb3c219 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:17.528858 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17cd1982-03d9-4101-b36f-916e0fb3c219 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:17.529694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17cd1982-03d9-4101-b36f-916e0fb3c219 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:17.680973 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-17cd1982-03d9-4101-b36f-916e0fb3c219 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:17.689923 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-17cd1982-03d9-4101-b36f-916e0fb3c219 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:17.691501 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-17cd1982-03d9-4101-b36f-916e0fb3c219 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:17.693030 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-17cd1982-03d9-4101-b36f-916e0fb3c219 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.184274 Aug 24 16:58:17.694164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 446/887] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:17 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:18.289663 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-47136714-b307-4e74-8fd4-9c7e40c13139 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:18.290808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-47136714-b307-4e74-8fd4-9c7e40c13139 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:18.297481 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-47136714-b307-4e74-8fd4-9c7e40c13139 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:18.298175 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-47136714-b307-4e74-8fd4-9c7e40c13139 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:18.298772 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-47136714-b307-4e74-8fd4-9c7e40c13139 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:18.299633 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-47136714-b307-4e74-8fd4-9c7e40c13139 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:18.300249 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-47136714-b307-4e74-8fd4-9c7e40c13139 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:18.300879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-47136714-b307-4e74-8fd4-9c7e40c13139 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:18.528774 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-47136714-b307-4e74-8fd4-9c7e40c13139 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:18.552670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-47136714-b307-4e74-8fd4-9c7e40c13139 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.266681 Aug 24 16:58:18.553891 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 442/888] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:18 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:18.719376 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d97854ae-baa7-4090-a086-ff1036b27ec5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:18.720878 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d97854ae-baa7-4090-a086-ff1036b27ec5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:18.728690 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d97854ae-baa7-4090-a086-ff1036b27ec5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:18.729433 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d97854ae-baa7-4090-a086-ff1036b27ec5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:18.730048 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d97854ae-baa7-4090-a086-ff1036b27ec5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:18.731034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d97854ae-baa7-4090-a086-ff1036b27ec5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:18.731644 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d97854ae-baa7-4090-a086-ff1036b27ec5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:18.732278 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d97854ae-baa7-4090-a086-ff1036b27ec5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:18.957011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d97854ae-baa7-4090-a086-ff1036b27ec5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:18.973137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d97854ae-baa7-4090-a086-ff1036b27ec5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:18.977931 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d97854ae-baa7-4090-a086-ff1036b27ec5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:18.977931 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d97854ae-baa7-4090-a086-ff1036b27ec5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.263747 Aug 24 16:58:18.977931 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 447/889] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:18 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:19.231640 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c59e9fd5-e305-4e4a-824e-64dff176aab1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Action: 'create', calling method: .version_select at 0x7fa194869430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1973815301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxXTkdZp5Fg3gIj9WPL8+kMgk9umHhYpQIpTnJA/dEqxg5BBOaB/ZesIkCWIJGRB/pkt4MAzH+MKE09fSaWzwFLcnwDlf21jvan7Ma7/BWJlj/f1i+9HjnE8zSHXh6lzQ=="}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:58:19.247884 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-c59e9fd5-e305-4e4a-824e-64dff176aab1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Getting quotas for project 805d6de24ff4415c89cba2d318ffd2f4. Resources: {'key_pairs'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:58:19.251945 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-c59e9fd5-e305-4e4a-824e-64dff176aab1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Getting quotas for user 701be5a3cff34016ab22b6dc4d23d939 and project 805d6de24ff4415c89cba2d318ffd2f4. Resources: {'key_pairs'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:58:19.354002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c59e9fd5-e305-4e4a-824e-64dff176aab1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.296573 Aug 24 16:58:19.356472 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 443/890] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Aug 24 16:58:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:58:19.576392 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9297fc4d-d6be-4eb7-ad2f-00a748170963 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:19.577314 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9297fc4d-d6be-4eb7-ad2f-00a748170963 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:19.585408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9297fc4d-d6be-4eb7-ad2f-00a748170963 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:19.589744 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9297fc4d-d6be-4eb7-ad2f-00a748170963 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:19.589744 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9297fc4d-d6be-4eb7-ad2f-00a748170963 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:19.589744 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9297fc4d-d6be-4eb7-ad2f-00a748170963 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:19.589744 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9297fc4d-d6be-4eb7-ad2f-00a748170963 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:19.590645 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9297fc4d-d6be-4eb7-ad2f-00a748170963 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:19.743182 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9297fc4d-d6be-4eb7-ad2f-00a748170963 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:19.750955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9297fc4d-d6be-4eb7-ad2f-00a748170963 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.178527 Aug 24 16:58:19.751523 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 448/891] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:19 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:20.000911 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3d797bf9-9228-43df-8dd5-7d15f6756a07 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:20.001629 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3d797bf9-9228-43df-8dd5-7d15f6756a07 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:20.008786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d797bf9-9228-43df-8dd5-7d15f6756a07 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:20.009279 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d797bf9-9228-43df-8dd5-7d15f6756a07 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:20.009725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d797bf9-9228-43df-8dd5-7d15f6756a07 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:20.010438 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d797bf9-9228-43df-8dd5-7d15f6756a07 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:20.010903 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d797bf9-9228-43df-8dd5-7d15f6756a07 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:20.011328 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d797bf9-9228-43df-8dd5-7d15f6756a07 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:20.153777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3d797bf9-9228-43df-8dd5-7d15f6756a07 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:20.163203 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3d797bf9-9228-43df-8dd5-7d15f6756a07 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:20.164888 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3d797bf9-9228-43df-8dd5-7d15f6756a07 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:20.166665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3d797bf9-9228-43df-8dd5-7d15f6756a07 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.169839 Aug 24 16:58:20.167225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 444/892] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:19 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:20.286702 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-a50133f7-48eb-48eb-a00b-1d4aa281f56f req-c358a4d4-77fe-41c6-95dc-43ead1eab8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d1714b-1531-428f-a205-e42cedf76d9b", "name": "network-vif-plugged", "status": "completed", "tag": "629e65e7-9a31-4acf-8a66-2220e5591487"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:58:20.303813 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-a50133f7-48eb-48eb-a00b-1d4aa281f56f req-c358a4d4-77fe-41c6-95dc-43ead1eab8e1 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:20.303813 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-a50133f7-48eb-48eb-a00b-1d4aa281f56f req-c358a4d4-77fe-41c6-95dc-43ead1eab8e1 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:20.303813 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-a50133f7-48eb-48eb-a00b-1d4aa281f56f req-c358a4d4-77fe-41c6-95dc-43ead1eab8e1 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:20.315967 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-a50133f7-48eb-48eb-a00b-1d4aa281f56f req-c358a4d4-77fe-41c6-95dc-43ead1eab8e1 service nova] Creating event network-vif-plugged:629e65e7-9a31-4acf-8a66-2220e5591487 for instance 09d1714b-1531-428f-a205-e42cedf76d9b on hv-cinder-85220 Aug 24 16:58:20.323640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-a50133f7-48eb-48eb-a00b-1d4aa281f56f req-c358a4d4-77fe-41c6-95dc-43ead1eab8e1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038074 Aug 24 16:58:20.324282 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 449/893] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:58:20.771204 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e4a62b61-b857-417d-bb86-4d0865c33694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:20.774210 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e4a62b61-b857-417d-bb86-4d0865c33694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:20.781888 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e4a62b61-b857-417d-bb86-4d0865c33694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:20.782425 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e4a62b61-b857-417d-bb86-4d0865c33694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:20.782871 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e4a62b61-b857-417d-bb86-4d0865c33694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:20.783626 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e4a62b61-b857-417d-bb86-4d0865c33694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:20.784081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e4a62b61-b857-417d-bb86-4d0865c33694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:20.784541 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e4a62b61-b857-417d-bb86-4d0865c33694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:20.805595 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:20.921429 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e4a62b61-b857-417d-bb86-4d0865c33694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:20.929209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e4a62b61-b857-417d-bb86-4d0865c33694 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.161958 Aug 24 16:58:20.930696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 445/894] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:20 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:21.192585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2b5031ca-8407-42bb-950f-0732f54aaf6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:21.193300 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2b5031ca-8407-42bb-950f-0732f54aaf6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:21.206167 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b5031ca-8407-42bb-950f-0732f54aaf6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:21.206668 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b5031ca-8407-42bb-950f-0732f54aaf6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:21.213230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b5031ca-8407-42bb-950f-0732f54aaf6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:21.214245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b5031ca-8407-42bb-950f-0732f54aaf6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:21.214892 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b5031ca-8407-42bb-950f-0732f54aaf6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:21.215547 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b5031ca-8407-42bb-950f-0732f54aaf6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:21.633579 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2b5031ca-8407-42bb-950f-0732f54aaf6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:21.646516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2b5031ca-8407-42bb-950f-0732f54aaf6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:21.652486 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2b5031ca-8407-42bb-950f-0732f54aaf6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:21.652486 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2b5031ca-8407-42bb-950f-0732f54aaf6a tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.463773 Aug 24 16:58:21.652486 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 450/895] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:21 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:21.949831 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-006d2523-2cb8-47a9-a943-2be8fc45dee6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:21.950456 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-006d2523-2cb8-47a9-a943-2be8fc45dee6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:21.957413 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-006d2523-2cb8-47a9-a943-2be8fc45dee6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:21.957905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-006d2523-2cb8-47a9-a943-2be8fc45dee6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:21.958348 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-006d2523-2cb8-47a9-a943-2be8fc45dee6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:21.959050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-006d2523-2cb8-47a9-a943-2be8fc45dee6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:21.959544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-006d2523-2cb8-47a9-a943-2be8fc45dee6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:21.959974 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-006d2523-2cb8-47a9-a943-2be8fc45dee6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:22.113885 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-006d2523-2cb8-47a9-a943-2be8fc45dee6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:22.124080 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-006d2523-2cb8-47a9-a943-2be8fc45dee6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.177568 Aug 24 16:58:22.124889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 446/896] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:21 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:22.673648 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-14fb83f1-d285-4653-aa02-86d6716bbbe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:22.674260 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-14fb83f1-d285-4653-aa02-86d6716bbbe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:22.681039 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14fb83f1-d285-4653-aa02-86d6716bbbe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:22.681792 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14fb83f1-d285-4653-aa02-86d6716bbbe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:22.682227 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14fb83f1-d285-4653-aa02-86d6716bbbe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:22.682922 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14fb83f1-d285-4653-aa02-86d6716bbbe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:22.683375 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14fb83f1-d285-4653-aa02-86d6716bbbe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:22.683926 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14fb83f1-d285-4653-aa02-86d6716bbbe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:22.822898 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-14fb83f1-d285-4653-aa02-86d6716bbbe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:22.831555 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-14fb83f1-d285-4653-aa02-86d6716bbbe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:22.833482 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-14fb83f1-d285-4653-aa02-86d6716bbbe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:22.841997 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-14fb83f1-d285-4653-aa02-86d6716bbbe7 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.172309 Aug 24 16:58:22.850019 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 451/897] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:22 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:23.146308 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-02363431-e78b-4a53-a11b-9bc1f675c5c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:23.151138 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-02363431-e78b-4a53-a11b-9bc1f675c5c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:23.153770 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-02363431-e78b-4a53-a11b-9bc1f675c5c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:23.154256 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-02363431-e78b-4a53-a11b-9bc1f675c5c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:23.154689 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-02363431-e78b-4a53-a11b-9bc1f675c5c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:23.155380 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-02363431-e78b-4a53-a11b-9bc1f675c5c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:23.155835 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-02363431-e78b-4a53-a11b-9bc1f675c5c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:23.156260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-02363431-e78b-4a53-a11b-9bc1f675c5c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:23.284998 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-02363431-e78b-4a53-a11b-9bc1f675c5c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:23.292858 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-02363431-e78b-4a53-a11b-9bc1f675c5c0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.150432 Aug 24 16:58:23.293406 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 447/898] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:23 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:23.871858 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3c072cf1-e8fc-4705-bec8-d255c699d01f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:23.873861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3c072cf1-e8fc-4705-bec8-d255c699d01f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:23.882948 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c072cf1-e8fc-4705-bec8-d255c699d01f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:23.883800 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c072cf1-e8fc-4705-bec8-d255c699d01f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:23.885213 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c072cf1-e8fc-4705-bec8-d255c699d01f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:23.886123 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c072cf1-e8fc-4705-bec8-d255c699d01f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:23.886634 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c072cf1-e8fc-4705-bec8-d255c699d01f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:23.887264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c072cf1-e8fc-4705-bec8-d255c699d01f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:24.052143 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3c072cf1-e8fc-4705-bec8-d255c699d01f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:24.061037 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3c072cf1-e8fc-4705-bec8-d255c699d01f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:24.062541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3c072cf1-e8fc-4705-bec8-d255c699d01f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:24.063700 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3c072cf1-e8fc-4705-bec8-d255c699d01f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.200425 Aug 24 16:58:24.064260 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 452/899] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:23 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:24.315862 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ceba5a5a-b5d0-4a0c-9c74-17fd6c775ab1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:24.317153 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ceba5a5a-b5d0-4a0c-9c74-17fd6c775ab1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:24.327384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ceba5a5a-b5d0-4a0c-9c74-17fd6c775ab1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:24.328184 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ceba5a5a-b5d0-4a0c-9c74-17fd6c775ab1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:24.328765 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ceba5a5a-b5d0-4a0c-9c74-17fd6c775ab1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:24.329537 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ceba5a5a-b5d0-4a0c-9c74-17fd6c775ab1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:24.330108 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ceba5a5a-b5d0-4a0c-9c74-17fd6c775ab1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:24.330680 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ceba5a5a-b5d0-4a0c-9c74-17fd6c775ab1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:24.404198 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-ffae96e3-9c80-4c03-b226-81041f7a49e3 req-ef39cd4b-e768-42ca-b18f-0c1986da4cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dedced4a-76f1-477b-8db0-19cef618a229", "name": "network-vif-plugged", "status": "completed", "tag": "898ca7b8-cd5f-448f-bb25-43f8b1ecfb52"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:58:24.418790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-ffae96e3-9c80-4c03-b226-81041f7a49e3 req-ef39cd4b-e768-42ca-b18f-0c1986da4cda service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:24.419363 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-ffae96e3-9c80-4c03-b226-81041f7a49e3 req-ef39cd4b-e768-42ca-b18f-0c1986da4cda service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:24.419794 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-ffae96e3-9c80-4c03-b226-81041f7a49e3 req-ef39cd4b-e768-42ca-b18f-0c1986da4cda service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:24.431588 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-ffae96e3-9c80-4c03-b226-81041f7a49e3 req-ef39cd4b-e768-42ca-b18f-0c1986da4cda service nova] Creating event network-vif-plugged:898ca7b8-cd5f-448f-bb25-43f8b1ecfb52 for instance dedced4a-76f1-477b-8db0-19cef618a229 on hv-cinder-85220 Aug 24 16:58:24.436390 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-ffae96e3-9c80-4c03-b226-81041f7a49e3 req-ef39cd4b-e768-42ca-b18f-0c1986da4cda service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035998 Aug 24 16:58:24.437014 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 453/900] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:58:24.480902 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ceba5a5a-b5d0-4a0c-9c74-17fd6c775ab1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:24.488798 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ceba5a5a-b5d0-4a0c-9c74-17fd6c775ab1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.178447 Aug 24 16:58:24.489367 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 448/901] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:24 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:58:25.088876 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b2699270-aa24-48c3-a2e6-6b1b42c5a13c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:25.090373 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b2699270-aa24-48c3-a2e6-6b1b42c5a13c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:25.097390 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2699270-aa24-48c3-a2e6-6b1b42c5a13c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:25.098241 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2699270-aa24-48c3-a2e6-6b1b42c5a13c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:25.098892 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2699270-aa24-48c3-a2e6-6b1b42c5a13c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:25.099767 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2699270-aa24-48c3-a2e6-6b1b42c5a13c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:25.100299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2699270-aa24-48c3-a2e6-6b1b42c5a13c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:25.100773 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2699270-aa24-48c3-a2e6-6b1b42c5a13c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:25.234987 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2699270-aa24-48c3-a2e6-6b1b42c5a13c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:25.243530 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2699270-aa24-48c3-a2e6-6b1b42c5a13c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:25.245083 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2699270-aa24-48c3-a2e6-6b1b42c5a13c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:25.246253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b2699270-aa24-48c3-a2e6-6b1b42c5a13c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1730 microversion: 2.20 time: 0.162752 Aug 24 16:58:25.246832 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 454/902] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:25 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:25.511143 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ce864595-3840-46cc-9992-d73a2c51c080 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:25.511758 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ce864595-3840-46cc-9992-d73a2c51c080 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:25.518317 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce864595-3840-46cc-9992-d73a2c51c080 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:25.518799 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce864595-3840-46cc-9992-d73a2c51c080 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:25.519237 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce864595-3840-46cc-9992-d73a2c51c080 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:25.519929 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce864595-3840-46cc-9992-d73a2c51c080 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:25.520472 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce864595-3840-46cc-9992-d73a2c51c080 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:25.520932 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce864595-3840-46cc-9992-d73a2c51c080 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:25.662042 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ce864595-3840-46cc-9992-d73a2c51c080 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:25.669751 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ce864595-3840-46cc-9992-d73a2c51c080 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1319 microversion: 2.1 time: 0.163235 Aug 24 16:58:25.670491 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 449/903] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:25 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:26.268915 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a411a09a-ea17-4c1a-b73b-9f1fe9609eb2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:26.269539 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a411a09a-ea17-4c1a-b73b-9f1fe9609eb2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:26.277002 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a411a09a-ea17-4c1a-b73b-9f1fe9609eb2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:26.277603 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a411a09a-ea17-4c1a-b73b-9f1fe9609eb2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:26.278048 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a411a09a-ea17-4c1a-b73b-9f1fe9609eb2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:26.278746 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a411a09a-ea17-4c1a-b73b-9f1fe9609eb2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:26.279405 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a411a09a-ea17-4c1a-b73b-9f1fe9609eb2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:26.280290 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a411a09a-ea17-4c1a-b73b-9f1fe9609eb2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:26.419935 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a411a09a-ea17-4c1a-b73b-9f1fe9609eb2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:26.432463 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a411a09a-ea17-4c1a-b73b-9f1fe9609eb2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:26.433943 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a411a09a-ea17-4c1a-b73b-9f1fe9609eb2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:26.435137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a411a09a-ea17-4c1a-b73b-9f1fe9609eb2 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1717 microversion: 2.20 time: 0.170191 Aug 24 16:58:26.435685 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 455/904] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:58:26 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1717 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:58:26.691236 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6d82fc5a-bde0-419f-bdd4-e2c127bd3348 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:26.691804 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6d82fc5a-bde0-419f-bdd4-e2c127bd3348 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:26.698792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6d82fc5a-bde0-419f-bdd4-e2c127bd3348 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:26.699272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6d82fc5a-bde0-419f-bdd4-e2c127bd3348 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:26.699705 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6d82fc5a-bde0-419f-bdd4-e2c127bd3348 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:26.700390 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6d82fc5a-bde0-419f-bdd4-e2c127bd3348 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:26.700872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6d82fc5a-bde0-419f-bdd4-e2c127bd3348 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:26.701297 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6d82fc5a-bde0-419f-bdd4-e2c127bd3348 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:26.834151 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6d82fc5a-bde0-419f-bdd4-e2c127bd3348 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:26.842513 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6d82fc5a-bde0-419f-bdd4-e2c127bd3348 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1507 microversion: 2.1 time: 0.155230 Aug 24 16:58:26.845006 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 450/905] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:26 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:52.825943 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a0dbe236-557f-4486-adf3-034294e9ff5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:52.826490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a0dbe236-557f-4486-adf3-034294e9ff5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:52.828849 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=59 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:52.829669 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=81 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:52.834390 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0dbe236-557f-4486-adf3-034294e9ff5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:52.834881 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0dbe236-557f-4486-adf3-034294e9ff5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:52.835322 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0dbe236-557f-4486-adf3-034294e9ff5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:52.836020 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0dbe236-557f-4486-adf3-034294e9ff5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:52.836504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0dbe236-557f-4486-adf3-034294e9ff5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:52.840611 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0dbe236-557f-4486-adf3-034294e9ff5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:52.860167 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a0dbe236-557f-4486-adf3-034294e9ff5a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/ips" status: 200 len: 149 microversion: 2.1 time: 0.038554 Aug 24 16:58:52.860868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 456/906] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Aug 24 16:58:52 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:58:55.526205 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b426779a-08b7-423e-931a-ea32dccc7578 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e83a64cb-6013-4d47-b47e-eff01592211e"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:58:55.526205 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b426779a-08b7-423e-931a-ea32dccc7578 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:55.527544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=4 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:55.527544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:55.527779 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=32 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:55.532575 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b426779a-08b7-423e-931a-ea32dccc7578 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:55.533062 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b426779a-08b7-423e-931a-ea32dccc7578 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:55.533495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b426779a-08b7-423e-931a-ea32dccc7578 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:55.534188 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b426779a-08b7-423e-931a-ea32dccc7578 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:55.534639 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b426779a-08b7-423e-931a-ea32dccc7578 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:55.535061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b426779a-08b7-423e-931a-ea32dccc7578 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:56.398980 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b426779a-08b7-423e-931a-ea32dccc7578 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "POST /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881026 Aug 24 16:58:56.399591 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 451/907] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 16:58:55 2022] POST /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments => generated 194 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:58:56.689096 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1071497993", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1973815301", "security_groups": [{"name": "tempest-secgroup-smoke-647078182"}], "block_device_mapping_v2": [{"uuid": "9cd59e31-936e-431a-b52e-bac4264e1ed1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b92bc0ae-a252-4a61-8a0b-b9b8262f1ac3"}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:58:56.798631 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] validate_networks() for [('b92bc0ae-a252-4a61-8a0b-b9b8262f1ac3', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:58:57.267124 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:58:57.267571 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:58:57.268045 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:58:57.268536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:58:57.268952 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:58:57.277463 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:57.277972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:57.278450 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:57.279171 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:57.280116 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:57.280576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:57.298324 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Getting quotas for project 805d6de24ff4415c89cba2d318ffd2f4. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:58:57.302303 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Getting quotas for user 701be5a3cff34016ab22b6dc4d23d939 and project 805d6de24ff4415c89cba2d318ffd2f4. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:58:57.357445 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:58:57.360096 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9cd59e31-936e-431a-b52e-bac4264e1ed1',volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:58:57.809299 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5bfc2c68-5931-46bf-b5e0-49b90c3675ed tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.125378 Aug 24 16:58:57.809944 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 457/908] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:58:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:58:57.822708 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d3eb085d-92a2-42d7-a7dd-52f80a4a1702 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:57.824245 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d3eb085d-92a2-42d7-a7dd-52f80a4a1702 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:57.880510 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d3eb085d-92a2-42d7-a7dd-52f80a4a1702 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:57.887346 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d3eb085d-92a2-42d7-a7dd-52f80a4a1702 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1095 microversion: 2.1 time: 0.069849 Aug 24 16:58:57.888151 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 452/909] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:57 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:58:58.908876 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d2ca7954-2a25-413e-8930-c550341b23dc tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:58.917903 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d2ca7954-2a25-413e-8930-c550341b23dc tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:58.960932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d2ca7954-2a25-413e-8930-c550341b23dc tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:58:58.968364 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d2ca7954-2a25-413e-8930-c550341b23dc tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1095 microversion: 2.1 time: 0.064544 Aug 24 16:58:58.969101 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 458/910] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:58 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:58:59.988666 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6012b236-5fc8-4647-b128-037c4810c786 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:58:59.989288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6012b236-5fc8-4647-b128-037c4810c786 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:58:59.996672 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6012b236-5fc8-4647-b128-037c4810c786 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:59.997158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6012b236-5fc8-4647-b128-037c4810c786 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:59.997598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6012b236-5fc8-4647-b128-037c4810c786 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:58:59.998284 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6012b236-5fc8-4647-b128-037c4810c786 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:58:59.998776 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6012b236-5fc8-4647-b128-037c4810c786 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:58:59.999199 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6012b236-5fc8-4647-b128-037c4810c786 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:00.063568 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6012b236-5fc8-4647-b128-037c4810c786 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:00.071262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6012b236-5fc8-4647-b128-037c4810c786 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1193 microversion: 2.1 time: 0.086560 Aug 24 16:59:00.071824 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 453/911] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:58:59 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:01.091609 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fce15b52-acf0-4a84-bd37-0a678051d0e6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:01.092324 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fce15b52-acf0-4a84-bd37-0a678051d0e6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:01.104071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fce15b52-acf0-4a84-bd37-0a678051d0e6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:01.104594 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fce15b52-acf0-4a84-bd37-0a678051d0e6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:01.105935 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fce15b52-acf0-4a84-bd37-0a678051d0e6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:01.106030 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fce15b52-acf0-4a84-bd37-0a678051d0e6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:01.106416 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fce15b52-acf0-4a84-bd37-0a678051d0e6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:01.106849 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fce15b52-acf0-4a84-bd37-0a678051d0e6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:01.251771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8ff672aa-a610-4bc1-80fb-a0b166fcbdac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "758da0b0-b86e-43c8-8610-499e1b6226c8", "device": "/dev/sdb"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:59:01.255597 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8ff672aa-a610-4bc1-80fb-a0b166fcbdac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:01.259258 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fce15b52-acf0-4a84-bd37-0a678051d0e6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:01.262648 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8ff672aa-a610-4bc1-80fb-a0b166fcbdac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:01.263382 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8ff672aa-a610-4bc1-80fb-a0b166fcbdac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:01.263853 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8ff672aa-a610-4bc1-80fb-a0b166fcbdac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:01.264654 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8ff672aa-a610-4bc1-80fb-a0b166fcbdac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:01.265485 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8ff672aa-a610-4bc1-80fb-a0b166fcbdac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:01.265911 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8ff672aa-a610-4bc1-80fb-a0b166fcbdac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:01.267120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fce15b52-acf0-4a84-bd37-0a678051d0e6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1278 microversion: 2.1 time: 0.179328 Aug 24 16:59:01.267706 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 459/912] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:01 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:02.026148 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-d7cb270d-9c1d-4fcc-8f63-1520686c1c0f req-068bfc53-0d8b-47a2-a148-5e682da392a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63aaebc2-8a55-4615-a3e7-7ac0dca58edf", "tag": "583f3e4f-cc38-42cf-a81e-3d86bb5ab443"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:59:02.039797 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-d7cb270d-9c1d-4fcc-8f63-1520686c1c0f req-068bfc53-0d8b-47a2-a148-5e682da392a5 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:02.040305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-d7cb270d-9c1d-4fcc-8f63-1520686c1c0f req-068bfc53-0d8b-47a2-a148-5e682da392a5 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:02.040753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-d7cb270d-9c1d-4fcc-8f63-1520686c1c0f req-068bfc53-0d8b-47a2-a148-5e682da392a5 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:02.051833 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-d7cb270d-9c1d-4fcc-8f63-1520686c1c0f req-068bfc53-0d8b-47a2-a148-5e682da392a5 service nova] Creating event network-changed:583f3e4f-cc38-42cf-a81e-3d86bb5ab443 for instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf on hv-cinder-85220 Aug 24 16:59:02.056881 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-d7cb270d-9c1d-4fcc-8f63-1520686c1c0f req-068bfc53-0d8b-47a2-a148-5e682da392a5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034265 Aug 24 16:59:02.057651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 460/913] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:02.103899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8ff672aa-a610-4bc1-80fb-a0b166fcbdac tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "POST /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857390 Aug 24 16:59:02.104628 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 454/914] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 16:59:01 2022] POST /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:59:02.287735 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7a2a6419-be5c-4fd5-9eaf-798f47a2e278 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:02.288549 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7a2a6419-be5c-4fd5-9eaf-798f47a2e278 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:02.295201 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a2a6419-be5c-4fd5-9eaf-798f47a2e278 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:02.296200 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a2a6419-be5c-4fd5-9eaf-798f47a2e278 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:02.296649 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a2a6419-be5c-4fd5-9eaf-798f47a2e278 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:02.297338 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a2a6419-be5c-4fd5-9eaf-798f47a2e278 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:02.297787 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a2a6419-be5c-4fd5-9eaf-798f47a2e278 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:02.298202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a2a6419-be5c-4fd5-9eaf-798f47a2e278 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:02.434609 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7a2a6419-be5c-4fd5-9eaf-798f47a2e278 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:02.442713 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7a2a6419-be5c-4fd5-9eaf-798f47a2e278 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1278 microversion: 2.1 time: 0.159196 Aug 24 16:59:02.445777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 461/915] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:02 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:03.463663 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-88372f86-cdb0-4526-91d8-75094b08ba43 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:03.464371 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-88372f86-cdb0-4526-91d8-75094b08ba43 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:03.471144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88372f86-cdb0-4526-91d8-75094b08ba43 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:03.471636 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88372f86-cdb0-4526-91d8-75094b08ba43 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:03.472077 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88372f86-cdb0-4526-91d8-75094b08ba43 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:03.472812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88372f86-cdb0-4526-91d8-75094b08ba43 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:03.473272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88372f86-cdb0-4526-91d8-75094b08ba43 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:03.473703 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88372f86-cdb0-4526-91d8-75094b08ba43 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:03.639131 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-88372f86-cdb0-4526-91d8-75094b08ba43 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:03.646804 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-88372f86-cdb0-4526-91d8-75094b08ba43 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1278 microversion: 2.1 time: 0.187309 Aug 24 16:59:03.655972 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 455/916] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:03 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:04.025658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ceb0a159-f08a-4210-89a8-2df8af4b279d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:04.030216 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ceb0a159-f08a-4210-89a8-2df8af4b279d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:04.033151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ceb0a159-f08a-4210-89a8-2df8af4b279d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:04.033632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ceb0a159-f08a-4210-89a8-2df8af4b279d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:04.034162 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ceb0a159-f08a-4210-89a8-2df8af4b279d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:04.034853 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ceb0a159-f08a-4210-89a8-2df8af4b279d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:04.035306 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ceb0a159-f08a-4210-89a8-2df8af4b279d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:04.035725 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ceb0a159-f08a-4210-89a8-2df8af4b279d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:04.116948 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-ceb0a159-f08a-4210-89a8-2df8af4b279d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lazy-loading 'services' on Instance uuid 0353f35e-4905-47aa-94d0-1332a0615eb0 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:59:04.325989 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ceb0a159-f08a-4210-89a8-2df8af4b279d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments/e83a64cb-6013-4d47-b47e-eff01592211e" status: 202 len: 0 microversion: 2.1 time: 0.303940 Aug 24 16:59:04.327212 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 462/917] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Aug 24 16:59:04 2022] DELETE /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments/e83a64cb-6013-4d47-b47e-eff01592211e => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:59:04.335547 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-46528528-23f1-40f2-9679-b973da91d593 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:04.337881 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-46528528-23f1-40f2-9679-b973da91d593 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:04.344426 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-46528528-23f1-40f2-9679-b973da91d593 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:04.344917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-46528528-23f1-40f2-9679-b973da91d593 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:04.345363 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-46528528-23f1-40f2-9679-b973da91d593 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:04.346062 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-46528528-23f1-40f2-9679-b973da91d593 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:04.346524 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-46528528-23f1-40f2-9679-b973da91d593 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:04.346946 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-46528528-23f1-40f2-9679-b973da91d593 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:04.376425 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-46528528-23f1-40f2-9679-b973da91d593 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044787 Aug 24 16:59:04.377124 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 456/918] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:59:04 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:04.667567 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-77f836fc-740c-4f1d-9932-f220def4ab68 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:04.668266 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-77f836fc-740c-4f1d-9932-f220def4ab68 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:04.674638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77f836fc-740c-4f1d-9932-f220def4ab68 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:04.675115 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77f836fc-740c-4f1d-9932-f220def4ab68 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:04.675550 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77f836fc-740c-4f1d-9932-f220def4ab68 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:04.676239 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77f836fc-740c-4f1d-9932-f220def4ab68 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:04.676728 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77f836fc-740c-4f1d-9932-f220def4ab68 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:04.677151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77f836fc-740c-4f1d-9932-f220def4ab68 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:04.823081 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-77f836fc-740c-4f1d-9932-f220def4ab68 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:04.831773 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-77f836fc-740c-4f1d-9932-f220def4ab68 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1278 microversion: 2.1 time: 0.168371 Aug 24 16:59:04.832327 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 463/919] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:04 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:05.389233 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9b7d8290-bb21-49d0-9811-82275f337b88 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:05.391415 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9b7d8290-bb21-49d0-9811-82275f337b88 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:05.397789 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9b7d8290-bb21-49d0-9811-82275f337b88 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:05.398281 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9b7d8290-bb21-49d0-9811-82275f337b88 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:05.398722 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9b7d8290-bb21-49d0-9811-82275f337b88 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:05.399423 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9b7d8290-bb21-49d0-9811-82275f337b88 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:05.399878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9b7d8290-bb21-49d0-9811-82275f337b88 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:05.400306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9b7d8290-bb21-49d0-9811-82275f337b88 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:05.430030 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9b7d8290-bb21-49d0-9811-82275f337b88 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044819 Aug 24 16:59:05.430596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 457/920] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:59:05 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:05.853087 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bd06d585-23ff-4589-92f7-758eba31d61f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:05.853709 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bd06d585-23ff-4589-92f7-758eba31d61f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:05.860632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd06d585-23ff-4589-92f7-758eba31d61f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:05.860632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd06d585-23ff-4589-92f7-758eba31d61f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:05.860981 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd06d585-23ff-4589-92f7-758eba31d61f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:05.861687 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd06d585-23ff-4589-92f7-758eba31d61f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:05.862143 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd06d585-23ff-4589-92f7-758eba31d61f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:05.862572 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd06d585-23ff-4589-92f7-758eba31d61f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:06.000707 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bd06d585-23ff-4589-92f7-758eba31d61f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:06.009284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bd06d585-23ff-4589-92f7-758eba31d61f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.159939 Aug 24 16:59:06.009874 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 464/921] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:05 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:06.442430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ad21e42d-0d21-4564-8c79-4f8c06f70fe3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:06.444657 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ad21e42d-0d21-4564-8c79-4f8c06f70fe3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:06.550173 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad21e42d-0d21-4564-8c79-4f8c06f70fe3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:06.550662 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad21e42d-0d21-4564-8c79-4f8c06f70fe3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:06.551095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad21e42d-0d21-4564-8c79-4f8c06f70fe3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:06.551793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad21e42d-0d21-4564-8c79-4f8c06f70fe3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:06.552240 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad21e42d-0d21-4564-8c79-4f8c06f70fe3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:06.552706 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad21e42d-0d21-4564-8c79-4f8c06f70fe3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:06.582287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ad21e42d-0d21-4564-8c79-4f8c06f70fe3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143919 Aug 24 16:59:06.582878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 458/922] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:59:06 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:07.031558 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e091cfb8-f4d4-4b11-b61b-8dcd9e42d885 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:07.032182 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e091cfb8-f4d4-4b11-b61b-8dcd9e42d885 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:07.038605 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e091cfb8-f4d4-4b11-b61b-8dcd9e42d885 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:07.039087 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e091cfb8-f4d4-4b11-b61b-8dcd9e42d885 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:07.039521 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e091cfb8-f4d4-4b11-b61b-8dcd9e42d885 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:07.040210 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e091cfb8-f4d4-4b11-b61b-8dcd9e42d885 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:07.040694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e091cfb8-f4d4-4b11-b61b-8dcd9e42d885 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:07.041120 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e091cfb8-f4d4-4b11-b61b-8dcd9e42d885 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:07.168226 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e091cfb8-f4d4-4b11-b61b-8dcd9e42d885 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:07.176003 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e091cfb8-f4d4-4b11-b61b-8dcd9e42d885 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.148813 Aug 24 16:59:07.176703 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 465/923] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:07 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:07.593973 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a826cfc9-099a-49f0-997c-1c946c644cca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:07.596084 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a826cfc9-099a-49f0-997c-1c946c644cca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:07.602465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a826cfc9-099a-49f0-997c-1c946c644cca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:07.602942 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a826cfc9-099a-49f0-997c-1c946c644cca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:07.603371 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a826cfc9-099a-49f0-997c-1c946c644cca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:07.604049 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a826cfc9-099a-49f0-997c-1c946c644cca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:07.604536 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a826cfc9-099a-49f0-997c-1c946c644cca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:07.604957 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a826cfc9-099a-49f0-997c-1c946c644cca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:07.633937 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a826cfc9-099a-49f0-997c-1c946c644cca tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Aug 24 16:59:07.634473 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 459/924] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:59:07 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:08.196732 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-761c4f85-c6d6-43c1-8a07-9cdb30cbe4e9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:08.197344 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-761c4f85-c6d6-43c1-8a07-9cdb30cbe4e9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:08.199246 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:08.204408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-761c4f85-c6d6-43c1-8a07-9cdb30cbe4e9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:08.204910 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-761c4f85-c6d6-43c1-8a07-9cdb30cbe4e9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:08.205341 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-761c4f85-c6d6-43c1-8a07-9cdb30cbe4e9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:08.206021 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-761c4f85-c6d6-43c1-8a07-9cdb30cbe4e9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:08.206471 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-761c4f85-c6d6-43c1-8a07-9cdb30cbe4e9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:08.206890 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-761c4f85-c6d6-43c1-8a07-9cdb30cbe4e9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:08.334189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-761c4f85-c6d6-43c1-8a07-9cdb30cbe4e9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:08.341692 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-761c4f85-c6d6-43c1-8a07-9cdb30cbe4e9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.148823 Aug 24 16:59:08.342300 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 466/925] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:08 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:08.647500 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5e411ece-42ef-4861-b1f0-0e4a338dae83 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:08.649660 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5e411ece-42ef-4861-b1f0-0e4a338dae83 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:08.651599 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:08.657317 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e411ece-42ef-4861-b1f0-0e4a338dae83 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:08.657793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e411ece-42ef-4861-b1f0-0e4a338dae83 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:08.658223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e411ece-42ef-4861-b1f0-0e4a338dae83 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:08.658904 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e411ece-42ef-4861-b1f0-0e4a338dae83 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:08.659351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e411ece-42ef-4861-b1f0-0e4a338dae83 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:08.659771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e411ece-42ef-4861-b1f0-0e4a338dae83 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:08.688866 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5e411ece-42ef-4861-b1f0-0e4a338dae83 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Aug 24 16:59:08.689402 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 460/926] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:59:08 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:09.363123 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fe246b06-0059-451a-85b1-20fc9cd0131f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:09.363746 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fe246b06-0059-451a-85b1-20fc9cd0131f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:09.365575 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=8 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:09.370782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe246b06-0059-451a-85b1-20fc9cd0131f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:09.385430 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe246b06-0059-451a-85b1-20fc9cd0131f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:09.385430 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe246b06-0059-451a-85b1-20fc9cd0131f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:09.385430 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe246b06-0059-451a-85b1-20fc9cd0131f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:09.385430 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe246b06-0059-451a-85b1-20fc9cd0131f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:09.385856 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe246b06-0059-451a-85b1-20fc9cd0131f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:09.507724 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fe246b06-0059-451a-85b1-20fc9cd0131f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:09.515781 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fe246b06-0059-451a-85b1-20fc9cd0131f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.157120 Aug 24 16:59:09.516340 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 467/927] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:09 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:09.700668 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-df5c2d90-854e-409b-b335-124fa4de9223 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:09.703237 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-df5c2d90-854e-409b-b335-124fa4de9223 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:09.709738 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df5c2d90-854e-409b-b335-124fa4de9223 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:09.710222 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df5c2d90-854e-409b-b335-124fa4de9223 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:09.710658 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df5c2d90-854e-409b-b335-124fa4de9223 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:09.711343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df5c2d90-854e-409b-b335-124fa4de9223 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:09.711796 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df5c2d90-854e-409b-b335-124fa4de9223 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:09.712221 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df5c2d90-854e-409b-b335-124fa4de9223 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:09.741104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-df5c2d90-854e-409b-b335-124fa4de9223 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044546 Aug 24 16:59:09.743372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 461/928] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:59:09 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:10.536371 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-76a326cc-40e4-458e-afb3-52dea1804fbb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:10.537021 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-76a326cc-40e4-458e-afb3-52dea1804fbb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:10.543758 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a326cc-40e4-458e-afb3-52dea1804fbb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:10.543941 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a326cc-40e4-458e-afb3-52dea1804fbb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:10.544377 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a326cc-40e4-458e-afb3-52dea1804fbb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:10.545097 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a326cc-40e4-458e-afb3-52dea1804fbb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:10.545555 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a326cc-40e4-458e-afb3-52dea1804fbb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:10.546656 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a326cc-40e4-458e-afb3-52dea1804fbb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:10.683077 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-76a326cc-40e4-458e-afb3-52dea1804fbb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:10.690854 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-76a326cc-40e4-458e-afb3-52dea1804fbb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.158263 Aug 24 16:59:10.692110 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 468/929] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:10 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:10.753418 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7b98c599-7142-452a-b203-36b68310cce2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:10.755865 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7b98c599-7142-452a-b203-36b68310cce2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:10.762297 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7b98c599-7142-452a-b203-36b68310cce2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:10.762784 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7b98c599-7142-452a-b203-36b68310cce2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:10.763225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7b98c599-7142-452a-b203-36b68310cce2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:10.763917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7b98c599-7142-452a-b203-36b68310cce2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:10.764379 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7b98c599-7142-452a-b203-36b68310cce2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:10.764830 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7b98c599-7142-452a-b203-36b68310cce2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:10.793770 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7b98c599-7142-452a-b203-36b68310cce2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Aug 24 16:59:10.794256 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 462/930] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:59:10 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:11.711104 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-976f90fe-42b0-4372-842a-7f37981c2d3b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:11.711719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-976f90fe-42b0-4372-842a-7f37981c2d3b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:11.718178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-976f90fe-42b0-4372-842a-7f37981c2d3b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:11.718657 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-976f90fe-42b0-4372-842a-7f37981c2d3b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:11.719088 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-976f90fe-42b0-4372-842a-7f37981c2d3b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:11.719774 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-976f90fe-42b0-4372-842a-7f37981c2d3b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:11.720252 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-976f90fe-42b0-4372-842a-7f37981c2d3b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:11.720729 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-976f90fe-42b0-4372-842a-7f37981c2d3b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:11.806959 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ab5b8485-1059-4dcd-9659-b301b5981829 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:11.809126 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ab5b8485-1059-4dcd-9659-b301b5981829 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:11.816477 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab5b8485-1059-4dcd-9659-b301b5981829 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:11.816976 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab5b8485-1059-4dcd-9659-b301b5981829 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:11.817415 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab5b8485-1059-4dcd-9659-b301b5981829 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:11.818131 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab5b8485-1059-4dcd-9659-b301b5981829 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:11.818590 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab5b8485-1059-4dcd-9659-b301b5981829 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:11.819021 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab5b8485-1059-4dcd-9659-b301b5981829 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:11.854046 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ab5b8485-1059-4dcd-9659-b301b5981829 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051193 Aug 24 16:59:11.854920 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 463/931] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:59:11 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:59:12.004298 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-976f90fe-42b0-4372-842a-7f37981c2d3b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:12.012213 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-976f90fe-42b0-4372-842a-7f37981c2d3b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.305006 Aug 24 16:59:12.012801 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 469/932] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:11 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:12.866740 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b3a5a3aa-55fd-4389-8d46-adfd4252a87d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:12.868988 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b3a5a3aa-55fd-4389-8d46-adfd4252a87d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:12.875831 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b3a5a3aa-55fd-4389-8d46-adfd4252a87d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:12.876305 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b3a5a3aa-55fd-4389-8d46-adfd4252a87d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:12.876762 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b3a5a3aa-55fd-4389-8d46-adfd4252a87d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:12.877450 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b3a5a3aa-55fd-4389-8d46-adfd4252a87d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:12.877918 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b3a5a3aa-55fd-4389-8d46-adfd4252a87d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:12.878335 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b3a5a3aa-55fd-4389-8d46-adfd4252a87d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:12.908621 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b3a5a3aa-55fd-4389-8d46-adfd4252a87d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045756 Aug 24 16:59:12.909170 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 464/933] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:59:12 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:13.033212 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b57bd36f-af62-4887-8caf-b99de87164dd tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:13.033868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b57bd36f-af62-4887-8caf-b99de87164dd tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:13.040267 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b57bd36f-af62-4887-8caf-b99de87164dd tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:13.040796 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b57bd36f-af62-4887-8caf-b99de87164dd tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:13.043940 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b57bd36f-af62-4887-8caf-b99de87164dd tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:13.043940 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b57bd36f-af62-4887-8caf-b99de87164dd tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:13.043940 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b57bd36f-af62-4887-8caf-b99de87164dd tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:13.043940 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b57bd36f-af62-4887-8caf-b99de87164dd tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:13.176213 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b57bd36f-af62-4887-8caf-b99de87164dd tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:13.183978 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b57bd36f-af62-4887-8caf-b99de87164dd tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.154617 Aug 24 16:59:13.184658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 470/934] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:13 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:13.920845 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-73878f9a-6f42-4aaf-87b3-c330984f68d5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:13.922974 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-73878f9a-6f42-4aaf-87b3-c330984f68d5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:13.929412 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-73878f9a-6f42-4aaf-87b3-c330984f68d5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:13.929934 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-73878f9a-6f42-4aaf-87b3-c330984f68d5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:13.930385 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-73878f9a-6f42-4aaf-87b3-c330984f68d5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:13.931047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-73878f9a-6f42-4aaf-87b3-c330984f68d5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:13.931494 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-73878f9a-6f42-4aaf-87b3-c330984f68d5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:13.931927 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-73878f9a-6f42-4aaf-87b3-c330984f68d5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:13.956651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:13.961305 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-73878f9a-6f42-4aaf-87b3-c330984f68d5 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044613 Aug 24 16:59:13.961859 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 465/935] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:59:13 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:14.205303 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8ee49138-5c5e-4123-a1cf-db323025d691 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:14.205908 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8ee49138-5c5e-4123-a1cf-db323025d691 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:14.212388 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ee49138-5c5e-4123-a1cf-db323025d691 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:14.212891 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ee49138-5c5e-4123-a1cf-db323025d691 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:14.213316 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ee49138-5c5e-4123-a1cf-db323025d691 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:14.213994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ee49138-5c5e-4123-a1cf-db323025d691 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:14.214439 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ee49138-5c5e-4123-a1cf-db323025d691 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:14.214855 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ee49138-5c5e-4123-a1cf-db323025d691 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:14.347658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8ee49138-5c5e-4123-a1cf-db323025d691 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:14.355631 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8ee49138-5c5e-4123-a1cf-db323025d691 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.154598 Aug 24 16:59:14.361259 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 471/936] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:14 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:14.973986 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7948282a-6eaf-4fe8-86e4-9fb43c3a15eb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:14.976156 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7948282a-6eaf-4fe8-86e4-9fb43c3a15eb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:14.984354 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7948282a-6eaf-4fe8-86e4-9fb43c3a15eb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:14.984861 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7948282a-6eaf-4fe8-86e4-9fb43c3a15eb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:14.985294 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7948282a-6eaf-4fe8-86e4-9fb43c3a15eb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:14.986166 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7948282a-6eaf-4fe8-86e4-9fb43c3a15eb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:14.986610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7948282a-6eaf-4fe8-86e4-9fb43c3a15eb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:14.987194 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7948282a-6eaf-4fe8-86e4-9fb43c3a15eb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:15.018019 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7948282a-6eaf-4fe8-86e4-9fb43c3a15eb tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047839 Aug 24 16:59:15.018783 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 466/937] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 16:59:14 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:59:15.083246 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-75f4e8a4-4f14-46eb-bc9c-e510474cf360 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:15.087423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-75f4e8a4-4f14-46eb-bc9c-e510474cf360 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:15.089720 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-75f4e8a4-4f14-46eb-bc9c-e510474cf360 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:15.090206 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-75f4e8a4-4f14-46eb-bc9c-e510474cf360 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:15.090643 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-75f4e8a4-4f14-46eb-bc9c-e510474cf360 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:15.091347 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-75f4e8a4-4f14-46eb-bc9c-e510474cf360 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:15.091796 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-75f4e8a4-4f14-46eb-bc9c-e510474cf360 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:15.092223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-75f4e8a4-4f14-46eb-bc9c-e510474cf360 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:15.126534 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-75f4e8a4-4f14-46eb-bc9c-e510474cf360 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:59:15.292447 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:15.377428 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5190cc26-7b02-471c-b53a-e8f49a04bad0 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:15.378177 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5190cc26-7b02-471c-b53a-e8f49a04bad0 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:15.384965 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5190cc26-7b02-471c-b53a-e8f49a04bad0 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:15.385557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5190cc26-7b02-471c-b53a-e8f49a04bad0 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:15.385997 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5190cc26-7b02-471c-b53a-e8f49a04bad0 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:15.386692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5190cc26-7b02-471c-b53a-e8f49a04bad0 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:15.387151 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5190cc26-7b02-471c-b53a-e8f49a04bad0 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:15.387578 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5190cc26-7b02-471c-b53a-e8f49a04bad0 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:15.531235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-5190cc26-7b02-471c-b53a-e8f49a04bad0 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:15.544174 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5190cc26-7b02-471c-b53a-e8f49a04bad0 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.171664 Aug 24 16:59:15.545215 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 467/938] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:15 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:15.546258 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-75f4e8a4-4f14-46eb-bc9c-e510474cf360 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 204 len: 0 microversion: 2.1 time: 0.466009 Aug 24 16:59:15.547084 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 472/939] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:59:15 2022] DELETE /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:59:15.559957 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d5abd1e4-4970-48e9-926c-2969191c6a05 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:15.560626 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d5abd1e4-4970-48e9-926c-2969191c6a05 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:15.567395 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d5abd1e4-4970-48e9-926c-2969191c6a05 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:15.567875 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d5abd1e4-4970-48e9-926c-2969191c6a05 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:15.568339 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d5abd1e4-4970-48e9-926c-2969191c6a05 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:15.569061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d5abd1e4-4970-48e9-926c-2969191c6a05 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:15.569514 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d5abd1e4-4970-48e9-926c-2969191c6a05 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:15.569932 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d5abd1e4-4970-48e9-926c-2969191c6a05 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:15.696927 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d5abd1e4-4970-48e9-926c-2969191c6a05 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:15.704615 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d5abd1e4-4970-48e9-926c-2969191c6a05 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1681 microversion: 2.1 time: 0.148980 Aug 24 16:59:15.705189 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 468/940] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:15 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:59:16.567056 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2a47015d-78a8-4dad-a98e-18105a9971b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:16.567762 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2a47015d-78a8-4dad-a98e-18105a9971b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:16.575040 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a47015d-78a8-4dad-a98e-18105a9971b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:16.575521 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a47015d-78a8-4dad-a98e-18105a9971b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:16.575955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a47015d-78a8-4dad-a98e-18105a9971b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:16.576684 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a47015d-78a8-4dad-a98e-18105a9971b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:16.577187 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a47015d-78a8-4dad-a98e-18105a9971b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:16.577606 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a47015d-78a8-4dad-a98e-18105a9971b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:16.721534 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2a47015d-78a8-4dad-a98e-18105a9971b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:16.726100 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ada87318-7047-4eb3-976c-8c9c0d995974 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:16.726719 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ada87318-7047-4eb3-976c-8c9c0d995974 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:16.729254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2a47015d-78a8-4dad-a98e-18105a9971b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.166835 Aug 24 16:59:16.730135 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 473/941] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:16 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:16.733218 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ada87318-7047-4eb3-976c-8c9c0d995974 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:16.734230 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ada87318-7047-4eb3-976c-8c9c0d995974 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:16.734666 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ada87318-7047-4eb3-976c-8c9c0d995974 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:16.735357 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ada87318-7047-4eb3-976c-8c9c0d995974 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:16.735809 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ada87318-7047-4eb3-976c-8c9c0d995974 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:16.736232 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ada87318-7047-4eb3-976c-8c9c0d995974 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:16.862899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ada87318-7047-4eb3-976c-8c9c0d995974 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:16.870479 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ada87318-7047-4eb3-976c-8c9c0d995974 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1681 microversion: 2.1 time: 0.148217 Aug 24 16:59:16.871046 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 469/942] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:16 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:59:17.751015 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d682f99a-3804-40df-8ecf-1f25e01dc3b4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:17.751733 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d682f99a-3804-40df-8ecf-1f25e01dc3b4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:17.758395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d682f99a-3804-40df-8ecf-1f25e01dc3b4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:17.758877 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d682f99a-3804-40df-8ecf-1f25e01dc3b4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:17.759309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d682f99a-3804-40df-8ecf-1f25e01dc3b4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:17.760003 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d682f99a-3804-40df-8ecf-1f25e01dc3b4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:17.760486 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d682f99a-3804-40df-8ecf-1f25e01dc3b4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:17.760905 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d682f99a-3804-40df-8ecf-1f25e01dc3b4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:17.797489 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-d781e7ca-e145-4d10-942e-9d7c8e80ec11 req-2473efd7-3607-40f5-964f-b52dd0f6c068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63aaebc2-8a55-4615-a3e7-7ac0dca58edf", "name": "network-vif-plugged", "status": "completed", "tag": "583f3e4f-cc38-42cf-a81e-3d86bb5ab443"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:59:17.817488 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-d781e7ca-e145-4d10-942e-9d7c8e80ec11 req-2473efd7-3607-40f5-964f-b52dd0f6c068 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:17.818077 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-d781e7ca-e145-4d10-942e-9d7c8e80ec11 req-2473efd7-3607-40f5-964f-b52dd0f6c068 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:17.818578 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-d781e7ca-e145-4d10-942e-9d7c8e80ec11 req-2473efd7-3607-40f5-964f-b52dd0f6c068 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:17.830413 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-d781e7ca-e145-4d10-942e-9d7c8e80ec11 req-2473efd7-3607-40f5-964f-b52dd0f6c068 service nova] Creating event network-vif-plugged:583f3e4f-cc38-42cf-a81e-3d86bb5ab443 for instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf on hv-cinder-85220 Aug 24 16:59:17.835681 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-d781e7ca-e145-4d10-942e-9d7c8e80ec11 req-2473efd7-3607-40f5-964f-b52dd0f6c068 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043563 Aug 24 16:59:17.837469 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 470/943] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:17.893997 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4be56976-ee44-4ba0-b39e-dbfff0d8b994 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:17.894984 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4be56976-ee44-4ba0-b39e-dbfff0d8b994 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:17.901527 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d682f99a-3804-40df-8ecf-1f25e01dc3b4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:17.902561 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4be56976-ee44-4ba0-b39e-dbfff0d8b994 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:17.903048 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4be56976-ee44-4ba0-b39e-dbfff0d8b994 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:17.903705 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4be56976-ee44-4ba0-b39e-dbfff0d8b994 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:17.904173 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4be56976-ee44-4ba0-b39e-dbfff0d8b994 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:17.904659 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4be56976-ee44-4ba0-b39e-dbfff0d8b994 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:17.905084 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4be56976-ee44-4ba0-b39e-dbfff0d8b994 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:17.910115 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d682f99a-3804-40df-8ecf-1f25e01dc3b4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.163659 Aug 24 16:59:17.911052 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 474/944] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:17 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:18.036289 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4be56976-ee44-4ba0-b39e-dbfff0d8b994 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:18.043896 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4be56976-ee44-4ba0-b39e-dbfff0d8b994 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1681 microversion: 2.1 time: 0.155096 Aug 24 16:59:18.044521 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 471/945] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:17 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:59:18.938234 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e73d870f-f662-4e8f-879f-024271c6569d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:18.938859 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e73d870f-f662-4e8f-879f-024271c6569d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:18.946102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e73d870f-f662-4e8f-879f-024271c6569d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:18.946598 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e73d870f-f662-4e8f-879f-024271c6569d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:18.947040 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e73d870f-f662-4e8f-879f-024271c6569d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:18.947770 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e73d870f-f662-4e8f-879f-024271c6569d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:18.948225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e73d870f-f662-4e8f-879f-024271c6569d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:18.948676 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e73d870f-f662-4e8f-879f-024271c6569d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:19.066079 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-19e5f65f-171e-4afa-b9f9-55cfebc0106d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:19.066828 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-19e5f65f-171e-4afa-b9f9-55cfebc0106d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:19.073377 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-19e5f65f-171e-4afa-b9f9-55cfebc0106d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:19.073926 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-19e5f65f-171e-4afa-b9f9-55cfebc0106d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:19.074382 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-19e5f65f-171e-4afa-b9f9-55cfebc0106d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:19.075080 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-19e5f65f-171e-4afa-b9f9-55cfebc0106d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:19.075537 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-19e5f65f-171e-4afa-b9f9-55cfebc0106d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:19.075967 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-19e5f65f-171e-4afa-b9f9-55cfebc0106d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:19.083810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e73d870f-f662-4e8f-879f-024271c6569d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:19.091566 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e73d870f-f662-4e8f-879f-024271c6569d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.164323 Aug 24 16:59:19.092124 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 475/946] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:18 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:19.207012 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-19e5f65f-171e-4afa-b9f9-55cfebc0106d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:19.214633 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-19e5f65f-171e-4afa-b9f9-55cfebc0106d tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1681 microversion: 2.1 time: 0.153238 Aug 24 16:59:19.215195 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 472/947] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:19 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:20.112711 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e98fc3d6-17f7-4dcc-b251-c87cb7d4e118 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:20.113383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e98fc3d6-17f7-4dcc-b251-c87cb7d4e118 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:20.119809 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e98fc3d6-17f7-4dcc-b251-c87cb7d4e118 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:20.120294 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e98fc3d6-17f7-4dcc-b251-c87cb7d4e118 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:20.120762 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e98fc3d6-17f7-4dcc-b251-c87cb7d4e118 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:20.121454 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e98fc3d6-17f7-4dcc-b251-c87cb7d4e118 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:20.121911 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e98fc3d6-17f7-4dcc-b251-c87cb7d4e118 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:20.122338 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e98fc3d6-17f7-4dcc-b251-c87cb7d4e118 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:20.235528 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-cb780137-c5dd-4ec3-ba89-ca86d29cda86 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:20.236074 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-cb780137-c5dd-4ec3-ba89-ca86d29cda86 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:20.242660 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb780137-c5dd-4ec3-ba89-ca86d29cda86 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:20.243152 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb780137-c5dd-4ec3-ba89-ca86d29cda86 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:20.243589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb780137-c5dd-4ec3-ba89-ca86d29cda86 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:20.244286 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb780137-c5dd-4ec3-ba89-ca86d29cda86 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:20.244815 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb780137-c5dd-4ec3-ba89-ca86d29cda86 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:20.245250 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb780137-c5dd-4ec3-ba89-ca86d29cda86 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:20.248753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e98fc3d6-17f7-4dcc-b251-c87cb7d4e118 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:20.256793 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e98fc3d6-17f7-4dcc-b251-c87cb7d4e118 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.148402 Aug 24 16:59:20.257470 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 476/948] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:20 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:20.373766 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cb780137-c5dd-4ec3-ba89-ca86d29cda86 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:20.381578 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-cb780137-c5dd-4ec3-ba89-ca86d29cda86 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1681 microversion: 2.1 time: 0.150608 Aug 24 16:59:20.382144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 473/949] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:20 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:59:21.277553 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4ee9e5c6-ea7d-4258-a887-0539c20cf94b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:21.278204 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4ee9e5c6-ea7d-4258-a887-0539c20cf94b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:21.284658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ee9e5c6-ea7d-4258-a887-0539c20cf94b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:21.285147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ee9e5c6-ea7d-4258-a887-0539c20cf94b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:21.285589 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ee9e5c6-ea7d-4258-a887-0539c20cf94b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:21.286289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ee9e5c6-ea7d-4258-a887-0539c20cf94b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:21.286775 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ee9e5c6-ea7d-4258-a887-0539c20cf94b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:21.287201 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ee9e5c6-ea7d-4258-a887-0539c20cf94b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:21.401986 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ab668908-e248-4b84-83aa-bd580b2451e4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:21.402725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ab668908-e248-4b84-83aa-bd580b2451e4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:21.409272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab668908-e248-4b84-83aa-bd580b2451e4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:21.409921 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab668908-e248-4b84-83aa-bd580b2451e4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:21.410428 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab668908-e248-4b84-83aa-bd580b2451e4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:21.411188 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab668908-e248-4b84-83aa-bd580b2451e4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:21.411717 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab668908-e248-4b84-83aa-bd580b2451e4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:21.412145 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab668908-e248-4b84-83aa-bd580b2451e4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:21.415253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4ee9e5c6-ea7d-4258-a887-0539c20cf94b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:21.423635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4ee9e5c6-ea7d-4258-a887-0539c20cf94b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.150000 Aug 24 16:59:21.424192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 477/950] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:21 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:21.542175 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ab668908-e248-4b84-83aa-bd580b2451e4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:21.550579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ab668908-e248-4b84-83aa-bd580b2451e4 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1681 microversion: 2.1 time: 0.152511 Aug 24 16:59:21.551142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 474/951] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:21 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:59:22.444450 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-973f0e01-af8a-422e-a93c-252bc768e6db tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:22.445093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-973f0e01-af8a-422e-a93c-252bc768e6db tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:22.451415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-973f0e01-af8a-422e-a93c-252bc768e6db tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:22.452425 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-973f0e01-af8a-422e-a93c-252bc768e6db tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:22.452858 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-973f0e01-af8a-422e-a93c-252bc768e6db tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:22.453541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-973f0e01-af8a-422e-a93c-252bc768e6db tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:22.453991 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-973f0e01-af8a-422e-a93c-252bc768e6db tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:22.454418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-973f0e01-af8a-422e-a93c-252bc768e6db tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:22.572393 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-594e5e2b-615a-453c-983d-6a087f0d36ea tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:22.573140 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-594e5e2b-615a-453c-983d-6a087f0d36ea tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:22.580265 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-594e5e2b-615a-453c-983d-6a087f0d36ea tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:22.580614 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-594e5e2b-615a-453c-983d-6a087f0d36ea tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:22.581053 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-594e5e2b-615a-453c-983d-6a087f0d36ea tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:22.581757 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-594e5e2b-615a-453c-983d-6a087f0d36ea tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:22.582218 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-594e5e2b-615a-453c-983d-6a087f0d36ea tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:22.582636 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-973f0e01-af8a-422e-a93c-252bc768e6db tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:22.582771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-594e5e2b-615a-453c-983d-6a087f0d36ea tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:22.590348 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-973f0e01-af8a-422e-a93c-252bc768e6db tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.149785 Aug 24 16:59:22.590914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 478/952] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:22 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:22.707578 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-594e5e2b-615a-453c-983d-6a087f0d36ea tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:22.715155 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-594e5e2b-615a-453c-983d-6a087f0d36ea tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1681 microversion: 2.1 time: 0.146625 Aug 24 16:59:22.715721 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 475/953] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:22 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:59:23.611176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1e9b275b-e7b6-46e8-acaa-af913fa05c96 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:23.611811 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1e9b275b-e7b6-46e8-acaa-af913fa05c96 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:23.618221 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e9b275b-e7b6-46e8-acaa-af913fa05c96 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:23.618700 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e9b275b-e7b6-46e8-acaa-af913fa05c96 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:23.619139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e9b275b-e7b6-46e8-acaa-af913fa05c96 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:23.619826 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e9b275b-e7b6-46e8-acaa-af913fa05c96 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:23.620281 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e9b275b-e7b6-46e8-acaa-af913fa05c96 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:23.620738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e9b275b-e7b6-46e8-acaa-af913fa05c96 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:23.736746 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a0ec5f0d-c050-48dd-828c-0f2473af9877 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:23.737480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a0ec5f0d-c050-48dd-828c-0f2473af9877 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:23.744057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a0ec5f0d-c050-48dd-828c-0f2473af9877 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:23.744577 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a0ec5f0d-c050-48dd-828c-0f2473af9877 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:23.745015 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a0ec5f0d-c050-48dd-828c-0f2473af9877 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:23.745703 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a0ec5f0d-c050-48dd-828c-0f2473af9877 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:23.746155 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a0ec5f0d-c050-48dd-828c-0f2473af9877 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:23.746573 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a0ec5f0d-c050-48dd-828c-0f2473af9877 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:23.751852 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1e9b275b-e7b6-46e8-acaa-af913fa05c96 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:23.759790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1e9b275b-e7b6-46e8-acaa-af913fa05c96 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.153004 Aug 24 16:59:23.760360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 479/954] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:23 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:23.874504 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a0ec5f0d-c050-48dd-828c-0f2473af9877 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:23.882594 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a0ec5f0d-c050-48dd-828c-0f2473af9877 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1681 microversion: 2.1 time: 0.150210 Aug 24 16:59:23.883164 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 476/955] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:23 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:24.780780 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0581c044-7c47-44d3-989a-3ea085f56ff9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:24.781391 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0581c044-7c47-44d3-989a-3ea085f56ff9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:24.787792 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0581c044-7c47-44d3-989a-3ea085f56ff9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:24.788273 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0581c044-7c47-44d3-989a-3ea085f56ff9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:24.788761 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0581c044-7c47-44d3-989a-3ea085f56ff9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:24.789436 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0581c044-7c47-44d3-989a-3ea085f56ff9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:24.789888 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0581c044-7c47-44d3-989a-3ea085f56ff9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:24.790311 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0581c044-7c47-44d3-989a-3ea085f56ff9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:24.905523 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-380ffd47-46d2-4cd9-87e1-6f837d48d0a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:24.906231 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-380ffd47-46d2-4cd9-87e1-6f837d48d0a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:24.912561 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-380ffd47-46d2-4cd9-87e1-6f837d48d0a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:24.913042 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-380ffd47-46d2-4cd9-87e1-6f837d48d0a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:24.913477 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-380ffd47-46d2-4cd9-87e1-6f837d48d0a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:24.914163 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-380ffd47-46d2-4cd9-87e1-6f837d48d0a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:24.914614 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-380ffd47-46d2-4cd9-87e1-6f837d48d0a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:24.915032 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-380ffd47-46d2-4cd9-87e1-6f837d48d0a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:24.923640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0581c044-7c47-44d3-989a-3ea085f56ff9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:24.931265 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0581c044-7c47-44d3-989a-3ea085f56ff9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.154835 Aug 24 16:59:24.931832 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 480/956] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:24 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:25.044557 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-380ffd47-46d2-4cd9-87e1-6f837d48d0a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:25.052784 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-380ffd47-46d2-4cd9-87e1-6f837d48d0a8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1681 microversion: 2.1 time: 0.151651 Aug 24 16:59:25.053345 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 477/957] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:24 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:25.678907 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-f94413ec-a96e-47fa-ab7e-ecfa7cf7a6d4 req-2ac732fb-9962-4fdb-b3e8-f7a0abe29928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0353f35e-4905-47aa-94d0-1332a0615eb0", "name": "network-vif-unplugged", "status": "completed", "tag": "ad61fcba-fcd0-4700-a7fc-4bf7acced400"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:59:25.688325 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-f94413ec-a96e-47fa-ab7e-ecfa7cf7a6d4 req-2ac732fb-9962-4fdb-b3e8-f7a0abe29928 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:25.689039 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-f94413ec-a96e-47fa-ab7e-ecfa7cf7a6d4 req-2ac732fb-9962-4fdb-b3e8-f7a0abe29928 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:25.689451 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-f94413ec-a96e-47fa-ab7e-ecfa7cf7a6d4 req-2ac732fb-9962-4fdb-b3e8-f7a0abe29928 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:25.700676 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-f94413ec-a96e-47fa-ab7e-ecfa7cf7a6d4 req-2ac732fb-9962-4fdb-b3e8-f7a0abe29928 service nova] Creating event network-vif-unplugged:ad61fcba-fcd0-4700-a7fc-4bf7acced400 for instance 0353f35e-4905-47aa-94d0-1332a0615eb0 on hv-cinder-85220 Aug 24 16:59:25.705632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-f94413ec-a96e-47fa-ab7e-ecfa7cf7a6d4 req-2ac732fb-9962-4fdb-b3e8-f7a0abe29928 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030884 Aug 24 16:59:25.706213 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 481/958] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:25.951740 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-262d098a-4b8f-411a-a27f-a1bbb7da8637 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:25.952261 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-262d098a-4b8f-411a-a27f-a1bbb7da8637 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:25.958570 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-262d098a-4b8f-411a-a27f-a1bbb7da8637 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:25.959057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-262d098a-4b8f-411a-a27f-a1bbb7da8637 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:25.959496 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-262d098a-4b8f-411a-a27f-a1bbb7da8637 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:25.960198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-262d098a-4b8f-411a-a27f-a1bbb7da8637 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:25.960677 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-262d098a-4b8f-411a-a27f-a1bbb7da8637 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:25.961102 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-262d098a-4b8f-411a-a27f-a1bbb7da8637 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:26.075016 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4eb4d1bf-f99b-455f-b5aa-99dc2ea26628 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:26.075929 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4eb4d1bf-f99b-455f-b5aa-99dc2ea26628 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:26.083439 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4eb4d1bf-f99b-455f-b5aa-99dc2ea26628 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:26.086423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4eb4d1bf-f99b-455f-b5aa-99dc2ea26628 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:26.086423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4eb4d1bf-f99b-455f-b5aa-99dc2ea26628 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:26.086423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4eb4d1bf-f99b-455f-b5aa-99dc2ea26628 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:26.086423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4eb4d1bf-f99b-455f-b5aa-99dc2ea26628 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:26.086767 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4eb4d1bf-f99b-455f-b5aa-99dc2ea26628 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:26.092967 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-262d098a-4b8f-411a-a27f-a1bbb7da8637 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:26.101061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-262d098a-4b8f-411a-a27f-a1bbb7da8637 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.153280 Aug 24 16:59:26.101645 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 478/959] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:25 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:26.227631 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4eb4d1bf-f99b-455f-b5aa-99dc2ea26628 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:26.235291 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4eb4d1bf-f99b-455f-b5aa-99dc2ea26628 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1681 microversion: 2.1 time: 0.164985 Aug 24 16:59:26.235857 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 482/960] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:26 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:59:26.723591 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-a510abd9-7c6c-4ed1-8a2a-f443ee0de894 req-780c47cc-7034-425a-9811-1fd8992d323f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0353f35e-4905-47aa-94d0-1332a0615eb0", "name": "network-vif-deleted", "tag": "ad61fcba-fcd0-4700-a7fc-4bf7acced400"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:59:26.728341 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=59 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:26.734310 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-a510abd9-7c6c-4ed1-8a2a-f443ee0de894 req-780c47cc-7034-425a-9811-1fd8992d323f service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:26.736078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-a510abd9-7c6c-4ed1-8a2a-f443ee0de894 req-780c47cc-7034-425a-9811-1fd8992d323f service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:26.736078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-a510abd9-7c6c-4ed1-8a2a-f443ee0de894 req-780c47cc-7034-425a-9811-1fd8992d323f service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:26.750092 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-a510abd9-7c6c-4ed1-8a2a-f443ee0de894 req-780c47cc-7034-425a-9811-1fd8992d323f service nova] Creating event network-vif-deleted:ad61fcba-fcd0-4700-a7fc-4bf7acced400 for instance 0353f35e-4905-47aa-94d0-1332a0615eb0 on hv-cinder-85220 Aug 24 16:59:26.755631 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-a510abd9-7c6c-4ed1-8a2a-f443ee0de894 req-780c47cc-7034-425a-9811-1fd8992d323f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035380 Aug 24 16:59:26.756562 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 479/961] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:27.121943 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b7b00a61-5f57-4bc2-ac58-a6c9f59edc28 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:27.123689 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b7b00a61-5f57-4bc2-ac58-a6c9f59edc28 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:27.125130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:27.134670 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7b00a61-5f57-4bc2-ac58-a6c9f59edc28 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:27.135535 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7b00a61-5f57-4bc2-ac58-a6c9f59edc28 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:27.136161 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7b00a61-5f57-4bc2-ac58-a6c9f59edc28 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:27.137128 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7b00a61-5f57-4bc2-ac58-a6c9f59edc28 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:27.137741 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7b00a61-5f57-4bc2-ac58-a6c9f59edc28 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:27.138322 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7b00a61-5f57-4bc2-ac58-a6c9f59edc28 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:27.259709 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:27.260536 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:27.275624 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:27.277899 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:27.280348 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:27.282221 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:27.282942 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:27.283470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:27.305885 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b7b00a61-5f57-4bc2-ac58-a6c9f59edc28 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:27.314622 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b7b00a61-5f57-4bc2-ac58-a6c9f59edc28 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1266 microversion: 2.1 time: 0.196543 Aug 24 16:59:27.329074 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 483/962] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:27 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:27.332065 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:27.332664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:27.333172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:27.333718 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lazy-loading 'fault' on Instance uuid 0353f35e-4905-47aa-94d0-1332a0615eb0 {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:59:27.380802 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88efd5eb09064aa2aa89e6d9580c6476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5b284e0b47422592057492601db382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:27.391133 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b5ada934-61ba-4e0d-b116-727c639fc7a2 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 200 len: 1331 microversion: 2.1 time: 0.137160 Aug 24 16:59:27.391831 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 480/963] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:27 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:28.337352 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-aff94661-2abb-48f9-8624-970d06fa280a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:28.337966 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-aff94661-2abb-48f9-8624-970d06fa280a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:28.345405 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aff94661-2abb-48f9-8624-970d06fa280a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:28.345888 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aff94661-2abb-48f9-8624-970d06fa280a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:28.346323 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aff94661-2abb-48f9-8624-970d06fa280a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:28.347009 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aff94661-2abb-48f9-8624-970d06fa280a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:28.347462 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aff94661-2abb-48f9-8624-970d06fa280a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:28.347884 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aff94661-2abb-48f9-8624-970d06fa280a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:28.411918 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6ebc385d-51ce-4da7-8fcf-477502b9f799 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:28.412559 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6ebc385d-51ce-4da7-8fcf-477502b9f799 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:28.419045 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6ebc385d-51ce-4da7-8fcf-477502b9f799 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:28.419529 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6ebc385d-51ce-4da7-8fcf-477502b9f799 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:28.419959 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6ebc385d-51ce-4da7-8fcf-477502b9f799 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:28.420675 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6ebc385d-51ce-4da7-8fcf-477502b9f799 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:28.421128 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6ebc385d-51ce-4da7-8fcf-477502b9f799 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:28.421549 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6ebc385d-51ce-4da7-8fcf-477502b9f799 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:28.435100 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-6ebc385d-51ce-4da7-8fcf-477502b9f799 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6ebc385d-51ce-4da7-8fcf-477502b9f799 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 HTTP/1.1 Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:59:28.436792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:59:28.438466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:59:28.438466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:28.438466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:28.438466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:28.438466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:28.438466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:59:28.438466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:59:28.438466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:59:28.438466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:28.438466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:59:28.438466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:28.438466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '0353f35e-4905-47aa-94d0-1332a0615eb0'} Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:28.439349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:28.440701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:28.442485 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6ebc385d-51ce-4da7-8fcf-477502b9f799 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 404 to user: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:28.442485 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6ebc385d-51ce-4da7-8fcf-477502b9f799 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 404 len: 111 microversion: 2.1 time: 0.030224 Aug 24 16:59:28.442485 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 481/964] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:28 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:59:28.446663 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-09bef6a4-2688-45ba-970b-4c4d9219d8b3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '.version_select at 0x7fa194a48ee0>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:28.477686 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-aff94661-2abb-48f9-8624-970d06fa280a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:28.485482 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-aff94661-2abb-48f9-8624-970d06fa280a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1453 microversion: 2.1 time: 0.151986 Aug 24 16:59:28.491752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 484/965] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:28 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:28.510265 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3f94c333-55f6-4b9c-ac7e-c3ed0e1a0dfe tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:28.511975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3f94c333-55f6-4b9c-ac7e-c3ed0e1a0dfe tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:28.517607 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f94c333-55f6-4b9c-ac7e-c3ed0e1a0dfe tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:28.518116 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f94c333-55f6-4b9c-ac7e-c3ed0e1a0dfe tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:28.518552 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f94c333-55f6-4b9c-ac7e-c3ed0e1a0dfe tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:28.519244 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f94c333-55f6-4b9c-ac7e-c3ed0e1a0dfe tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:28.519725 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f94c333-55f6-4b9c-ac7e-c3ed0e1a0dfe tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:28.520156 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f94c333-55f6-4b9c-ac7e-c3ed0e1a0dfe tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:28.534089 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-09bef6a4-2688-45ba-970b-4c4d9219d8b3 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513236172" status: 202 len: 0 microversion: 2.1 time: 0.090794 Aug 24 16:59:28.534666 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 482/966] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Aug 24 16:59:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513236172 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:59:28.662910 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3f94c333-55f6-4b9c-ac7e-c3ed0e1a0dfe tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:28.670727 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3f94c333-55f6-4b9c-ac7e-c3ed0e1a0dfe tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1453 microversion: 2.1 time: 0.164521 Aug 24 16:59:28.671287 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 485/967] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:28 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:59:30.611938 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-3a892527-b24e-4a6b-9c72-75ceb2966c37 req-2536be45-532d-4ec0-ae4e-fa8313eae050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63aaebc2-8a55-4615-a3e7-7ac0dca58edf", "tag": "583f3e4f-cc38-42cf-a81e-3d86bb5ab443"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:59:30.622121 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-3a892527-b24e-4a6b-9c72-75ceb2966c37 req-2536be45-532d-4ec0-ae4e-fa8313eae050 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:30.622599 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-3a892527-b24e-4a6b-9c72-75ceb2966c37 req-2536be45-532d-4ec0-ae4e-fa8313eae050 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:30.623032 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-3a892527-b24e-4a6b-9c72-75ceb2966c37 req-2536be45-532d-4ec0-ae4e-fa8313eae050 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:30.634344 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-3a892527-b24e-4a6b-9c72-75ceb2966c37 req-2536be45-532d-4ec0-ae4e-fa8313eae050 service nova] Creating event network-changed:583f3e4f-cc38-42cf-a81e-3d86bb5ab443 for instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf on hv-cinder-85220 Aug 24 16:59:30.639493 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-3a892527-b24e-4a6b-9c72-75ceb2966c37 req-2536be45-532d-4ec0-ae4e-fa8313eae050 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032647 Aug 24 16:59:30.640085 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 483/968] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:33.731085 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-84eae68c-5cff-489a-944e-0b99c6b76220 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:33.731591 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-84eae68c-5cff-489a-944e-0b99c6b76220 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:33.738267 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84eae68c-5cff-489a-944e-0b99c6b76220 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:33.738752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84eae68c-5cff-489a-944e-0b99c6b76220 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:33.739189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84eae68c-5cff-489a-944e-0b99c6b76220 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:33.739878 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84eae68c-5cff-489a-944e-0b99c6b76220 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:33.740336 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84eae68c-5cff-489a-944e-0b99c6b76220 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:33.740788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84eae68c-5cff-489a-944e-0b99c6b76220 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:33.754552 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-84eae68c-5cff-489a-944e-0b99c6b76220 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-84eae68c-5cff-489a-944e-0b99c6b76220 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: DELETE /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 HTTP/1.1 Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:59:33.756504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:59:33.758141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:59:33.758141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:33.758141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:33.758141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:33.758141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:33.758141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:59:33.758141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:59:33.758141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:59:33.758141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:33.758141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:59:33.758141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:33.758141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '0353f35e-4905-47aa-94d0-1332a0615eb0'} Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:33.759296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:33.761415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:33.763027 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-84eae68c-5cff-489a-944e-0b99c6b76220 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 404 to user: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:33.763027 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-84eae68c-5cff-489a-944e-0b99c6b76220 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 404 len: 111 microversion: 2.1 time: 0.030656 Aug 24 16:59:33.763027 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 486/969] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:59:33 2022] DELETE /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:59:33.767686 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-55800fe7-7374-4ea9-bd1a-b8f1d8def24e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:33.768393 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-55800fe7-7374-4ea9-bd1a-b8f1d8def24e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 0353f35e-4905-47aa-94d0-1332a0615eb0] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:33.774468 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-55800fe7-7374-4ea9-bd1a-b8f1d8def24e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:33.774960 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-55800fe7-7374-4ea9-bd1a-b8f1d8def24e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:33.775401 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-55800fe7-7374-4ea9-bd1a-b8f1d8def24e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:33.776099 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-55800fe7-7374-4ea9-bd1a-b8f1d8def24e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:33.776598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-55800fe7-7374-4ea9-bd1a-b8f1d8def24e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:33.777035 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-55800fe7-7374-4ea9-bd1a-b8f1d8def24e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:33.790613 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-55800fe7-7374-4ea9-bd1a-b8f1d8def24e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-55800fe7-7374-4ea9-bd1a-b8f1d8def24e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 HTTP/1.1 Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:59:33.792254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:59:33.793822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:59:33.793822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:33.793822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:33.793822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:33.793822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:33.793822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:59:33.793822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:59:33.793822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:59:33.793822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:33.793822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:59:33.793822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:33.793822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '0353f35e-4905-47aa-94d0-1332a0615eb0'} Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:33.794714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. Aug 24 16:59:33.796602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:33.798007 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-55800fe7-7374-4ea9-bd1a-b8f1d8def24e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 404 to user: Instance 0353f35e-4905-47aa-94d0-1332a0615eb0 could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:33.798007 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-55800fe7-7374-4ea9-bd1a-b8f1d8def24e tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0" status: 404 len: 111 microversion: 2.1 time: 0.031252 Aug 24 16:59:33.798544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 484/970] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:33 2022] GET /compute/v2.1/servers/0353f35e-4905-47aa-94d0-1332a0615eb0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:59:35.103850 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-188659c0-6416-48ce-909c-d2eca4be2f7b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:35.103850 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-188659c0-6416-48ce-909c-d2eca4be2f7b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:35.109150 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-188659c0-6416-48ce-909c-d2eca4be2f7b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:35.109624 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-188659c0-6416-48ce-909c-d2eca4be2f7b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:35.110047 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-188659c0-6416-48ce-909c-d2eca4be2f7b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:35.110729 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-188659c0-6416-48ce-909c-d2eca4be2f7b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:35.111175 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-188659c0-6416-48ce-909c-d2eca4be2f7b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:35.111593 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-188659c0-6416-48ce-909c-d2eca4be2f7b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:35.124731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-188659c0-6416-48ce-909c-d2eca4be2f7b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-188659c0-6416-48ce-909c-d2eca4be2f7b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: DELETE /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 HTTP/1.1 Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:59:35.126356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:59:35.127975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:59:35.127975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:35.127975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:35.127975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:35.127975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:35.127975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:59:35.127975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:59:35.127975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:59:35.127975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:35.127975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:59:35.127975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:59:35.127975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '80f7a331-c982-4209-87fb-bf041c901c56'} Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:35.128932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:59:35.130734 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.132377 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-188659c0-6416-48ce-909c-d2eca4be2f7b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 404 to user: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:35.132377 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-188659c0-6416-48ce-909c-d2eca4be2f7b tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 404 len: 111 microversion: 2.1 time: 0.029213 Aug 24 16:59:35.132377 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 487/971] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:59:35 2022] DELETE /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:59:35.136367 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b20fb013-f2e8-41a1-b2d1-870177282705 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:35.137075 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b20fb013-f2e8-41a1-b2d1-870177282705 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 80f7a331-c982-4209-87fb-bf041c901c56] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:35.143889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b20fb013-f2e8-41a1-b2d1-870177282705 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:35.144364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b20fb013-f2e8-41a1-b2d1-870177282705 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:35.144826 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b20fb013-f2e8-41a1-b2d1-870177282705 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:35.145506 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b20fb013-f2e8-41a1-b2d1-870177282705 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:35.145954 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b20fb013-f2e8-41a1-b2d1-870177282705 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:35.146372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b20fb013-f2e8-41a1-b2d1-870177282705 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:35.160158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-b20fb013-f2e8-41a1-b2d1-870177282705 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b20fb013-f2e8-41a1-b2d1-870177282705 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 HTTP/1.1 Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:59:35.161777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:59:35.163347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:59:35.163347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:35.163347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:35.163347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:35.163347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:35.163347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:59:35.163347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:59:35.163347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:59:35.163347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:35.163347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:59:35.163347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:59:35.163347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '80f7a331-c982-4209-87fb-bf041c901c56'} Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:35.164209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. Aug 24 16:59:35.172795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.174326 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b20fb013-f2e8-41a1-b2d1-870177282705 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 404 to user: Instance 80f7a331-c982-4209-87fb-bf041c901c56 could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:35.174326 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b20fb013-f2e8-41a1-b2d1-870177282705 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56" status: 404 len: 111 microversion: 2.1 time: 0.030633 Aug 24 16:59:35.174326 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 485/972] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:35 2022] GET /compute/v2.1/servers/80f7a331-c982-4209-87fb-bf041c901c56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:59:35.179011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-73b1a8f0-f09b-447a-87d8-21a1725d83b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:35.179523 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-73b1a8f0-f09b-447a-87d8-21a1725d83b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:35.185954 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73b1a8f0-f09b-447a-87d8-21a1725d83b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:35.186439 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73b1a8f0-f09b-447a-87d8-21a1725d83b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:35.186869 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73b1a8f0-f09b-447a-87d8-21a1725d83b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:35.187600 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73b1a8f0-f09b-447a-87d8-21a1725d83b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:35.188054 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73b1a8f0-f09b-447a-87d8-21a1725d83b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:35.188533 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73b1a8f0-f09b-447a-87d8-21a1725d83b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:35.202666 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-73b1a8f0-f09b-447a-87d8-21a1725d83b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-73b1a8f0-f09b-447a-87d8-21a1725d83b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: DELETE /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 HTTP/1.1 Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:59:35.204312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:59:35.206102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:59:35.206102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:35.206102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:35.206102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:35.206102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:35.206102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:59:35.206102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:59:35.206102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:59:35.206102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:35.206102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:59:35.206102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:59:35.206102 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '92b81578-b6c8-4fbf-9451-51d1fec79b91'} Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:35.207070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:59:35.208581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.223294 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-73b1a8f0-f09b-447a-87d8-21a1725d83b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 404 to user: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:35.223294 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-73b1a8f0-f09b-447a-87d8-21a1725d83b8 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 404 len: 111 microversion: 2.1 time: 0.031158 Aug 24 16:59:35.223294 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 488/973] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:59:35 2022] DELETE /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:59:35.223613 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1f958627-3a52-468a-ac3f-2b92a814bd71 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:35.223613 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1f958627-3a52-468a-ac3f-2b92a814bd71 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: 92b81578-b6c8-4fbf-9451-51d1fec79b91] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:35.223613 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f958627-3a52-468a-ac3f-2b92a814bd71 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:35.223613 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f958627-3a52-468a-ac3f-2b92a814bd71 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:35.224019 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f958627-3a52-468a-ac3f-2b92a814bd71 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:35.224019 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f958627-3a52-468a-ac3f-2b92a814bd71 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:35.224019 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f958627-3a52-468a-ac3f-2b92a814bd71 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:35.224019 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1f958627-3a52-468a-ac3f-2b92a814bd71 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:35.236919 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-1f958627-3a52-468a-ac3f-2b92a814bd71 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1f958627-3a52-468a-ac3f-2b92a814bd71 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 HTTP/1.1 Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:59:35.238411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:59:35.239970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:59:35.239970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:35.239970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:35.239970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:35.239970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:35.239970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:59:35.239970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:59:35.239970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:59:35.239970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:35.239970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:59:35.239970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:59:35.239970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '92b81578-b6c8-4fbf-9451-51d1fec79b91'} Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:35.240951 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. Aug 24 16:59:35.242589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:35.243910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1f958627-3a52-468a-ac3f-2b92a814bd71 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 404 to user: Instance 92b81578-b6c8-4fbf-9451-51d1fec79b91 could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:35.243910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1f958627-3a52-468a-ac3f-2b92a814bd71 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91" status: 404 len: 111 microversion: 2.1 time: 0.029301 Aug 24 16:59:35.243910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 486/974] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:35 2022] GET /compute/v2.1/servers/92b81578-b6c8-4fbf-9451-51d1fec79b91 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:59:36.526093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9c085e4d-5d2d-45d8-a2e3-448b0e062533 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:36.526586 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9c085e4d-5d2d-45d8-a2e3-448b0e062533 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:36.532872 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c085e4d-5d2d-45d8-a2e3-448b0e062533 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:36.533345 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c085e4d-5d2d-45d8-a2e3-448b0e062533 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:36.533777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c085e4d-5d2d-45d8-a2e3-448b0e062533 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:36.534452 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c085e4d-5d2d-45d8-a2e3-448b0e062533 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:36.534897 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c085e4d-5d2d-45d8-a2e3-448b0e062533 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:36.535318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c085e4d-5d2d-45d8-a2e3-448b0e062533 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:36.549245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-9c085e4d-5d2d-45d8-a2e3-448b0e062533 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9c085e4d-5d2d-45d8-a2e3-448b0e062533 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: DELETE /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 HTTP/1.1 Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 16:59:36.550824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 16:59:36.552455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:59:36.552455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:36.552455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:36.552455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:36.552455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:36.552455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 16:59:36.552455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 16:59:36.552455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:59:36.552455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:36.552455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 16:59:36.552455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:59:36.552455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': 'ff0a3b74-291b-4381-b945-50b48a823978'} Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:36.553458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:59:36.555053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 16:59:36.556902 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9c085e4d-5d2d-45d8-a2e3-448b0e062533 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 404 to user: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:36.556902 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9c085e4d-5d2d-45d8-a2e3-448b0e062533 tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 404 len: 111 microversion: 2.1 time: 0.030007 Aug 24 16:59:36.556902 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 489/975] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:59:36 2022] DELETE /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:59:36.560425 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b7c4109f-5f73-4673-8ec6-0ffc55effc4a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:36.561699 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b7c4109f-5f73-4673-8ec6-0ffc55effc4a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] [instance: ff0a3b74-291b-4381-b945-50b48a823978] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:36.568003 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7c4109f-5f73-4673-8ec6-0ffc55effc4a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:36.568511 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7c4109f-5f73-4673-8ec6-0ffc55effc4a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:36.568947 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7c4109f-5f73-4673-8ec6-0ffc55effc4a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:36.569640 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7c4109f-5f73-4673-8ec6-0ffc55effc4a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:36.570089 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7c4109f-5f73-4673-8ec6-0ffc55effc4a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:36.570507 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b7c4109f-5f73-4673-8ec6-0ffc55effc4a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:36.583554 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-b7c4109f-5f73-4673-8ec6-0ffc55effc4a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] HTTP exception thrown: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b7c4109f-5f73-4673-8ec6-0ffc55effc4a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Request method failure captured: Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 HTTP/1.1 Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZKZL7nnLsv7LRXzIUKt9uN7cJhWOt2CGCFfhKRVN-zNrrQSJ9D3bX3u6yZLv6GM9028zCRuUCbHUHHUXPRLFdeI2PUXP8o3wt5SgNXB_SqSCAtCuusCNhZM4zrLg51r9CF0mmVQ6WpuiyGNMGoASq9aiuXCgzHwALVkt4VXBkJeDg Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:59:36.585076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:59:36.586661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b5b284e0b47422592057492601db382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b5b284e0b47422592057492601db382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b5b284e0b47422592057492601db382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:59:36.586661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:36.586661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 6b5b284e0b47422592057492601db382 Aug 24 16:59:36.586661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1294111661 Aug 24 16:59:36.586661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:36.586661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:59:36.586661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:59:36.586661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 88efd5eb09064aa2aa89e6d9580c6476 Aug 24 16:59:36.586661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-AttachVolumeNegativeTest-1294111661-project Aug 24 16:59:36.586661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:59:36.586661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:59:36.586661 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': 'ff0a3b74-291b-4381-b945-50b48a823978'} Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:36.587497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. Aug 24 16:59:36.588793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:36.589920 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b7c4109f-5f73-4673-8ec6-0ffc55effc4a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] Returning 404 to user: Instance ff0a3b74-291b-4381-b945-50b48a823978 could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:36.589920 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b7c4109f-5f73-4673-8ec6-0ffc55effc4a tempest-AttachVolumeNegativeTest-1294111661 tempest-AttachVolumeNegativeTest-1294111661-project] 10.222.0.70 "GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978" status: 404 len: 111 microversion: 2.1 time: 0.029808 Aug 24 16:59:36.589920 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 487/976] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:36 2022] GET /compute/v2.1/servers/ff0a3b74-291b-4381-b945-50b48a823978 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:59:37.332104 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3609b8ed-ecda-4676-8982-fde0b4d00767 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:37.332638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3609b8ed-ecda-4676-8982-fde0b4d00767 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:37.338634 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3609b8ed-ecda-4676-8982-fde0b4d00767 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:37.339115 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3609b8ed-ecda-4676-8982-fde0b4d00767 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:37.339549 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3609b8ed-ecda-4676-8982-fde0b4d00767 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:37.340243 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3609b8ed-ecda-4676-8982-fde0b4d00767 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:37.340722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3609b8ed-ecda-4676-8982-fde0b4d00767 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:37.341147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3609b8ed-ecda-4676-8982-fde0b4d00767 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:37.423422 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-3609b8ed-ecda-4676-8982-fde0b4d00767 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lazy-loading 'services' on Instance uuid dedced4a-76f1-477b-8db0-19cef618a229 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:59:37.635580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3609b8ed-ecda-4676-8982-fde0b4d00767 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229/os-volume_attachments/758da0b0-b86e-43c8-8610-499e1b6226c8" status: 202 len: 0 microversion: 2.1 time: 0.307061 Aug 24 16:59:37.640059 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 490/977] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Aug 24 16:59:37 2022] DELETE /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229/os-volume_attachments/758da0b0-b86e-43c8-8610-499e1b6226c8 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:59:38.782696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9edac444-5706-4ffb-ab6d-721ec5e7314e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:38.783224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9edac444-5706-4ffb-ab6d-721ec5e7314e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:38.790838 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9edac444-5706-4ffb-ab6d-721ec5e7314e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:38.791312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9edac444-5706-4ffb-ab6d-721ec5e7314e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:38.792314 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9edac444-5706-4ffb-ab6d-721ec5e7314e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:38.793063 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9edac444-5706-4ffb-ab6d-721ec5e7314e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:38.793524 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9edac444-5706-4ffb-ab6d-721ec5e7314e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:38.793957 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9edac444-5706-4ffb-ab6d-721ec5e7314e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:38.815358 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=100 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:38.823339 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9edac444-5706-4ffb-ab6d-721ec5e7314e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Going to try to terminate instance {{(pid=127715) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:59:39.144529 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9edac444-5706-4ffb-ab6d-721ec5e7314e tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 204 len: 0 microversion: 2.1 time: 0.365360 Aug 24 16:59:39.145128 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 488/978] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 16:59:38 2022] DELETE /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:59:39.155603 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c9895f9e-8290-47b6-85a2-c530c996f6f6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:39.156526 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c9895f9e-8290-47b6-85a2-c530c996f6f6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:39.163397 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9895f9e-8290-47b6-85a2-c530c996f6f6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:39.163876 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9895f9e-8290-47b6-85a2-c530c996f6f6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:39.164355 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9895f9e-8290-47b6-85a2-c530c996f6f6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:39.165079 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9895f9e-8290-47b6-85a2-c530c996f6f6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:39.165525 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9895f9e-8290-47b6-85a2-c530c996f6f6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:39.165963 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9895f9e-8290-47b6-85a2-c530c996f6f6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:39.297389 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c9895f9e-8290-47b6-85a2-c530c996f6f6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:39.307484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c9895f9e-8290-47b6-85a2-c530c996f6f6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1513 microversion: 2.1 time: 0.157796 Aug 24 16:59:39.308060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 491/979] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:39 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:40.328688 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5dad94d9-4fc7-44dd-b117-556ad6590ae8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:40.330332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5dad94d9-4fc7-44dd-b117-556ad6590ae8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:40.336522 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5dad94d9-4fc7-44dd-b117-556ad6590ae8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:40.337025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5dad94d9-4fc7-44dd-b117-556ad6590ae8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:40.337467 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5dad94d9-4fc7-44dd-b117-556ad6590ae8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:40.338174 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5dad94d9-4fc7-44dd-b117-556ad6590ae8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:40.338635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5dad94d9-4fc7-44dd-b117-556ad6590ae8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:40.339067 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5dad94d9-4fc7-44dd-b117-556ad6590ae8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:40.470656 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-5dad94d9-4fc7-44dd-b117-556ad6590ae8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:40.478336 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5dad94d9-4fc7-44dd-b117-556ad6590ae8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1513 microversion: 2.1 time: 0.154511 Aug 24 16:59:40.478937 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 489/980] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:40 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:41.499333 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-67fcec57-f933-4aa2-b250-33206df61f58 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:41.502622 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-67fcec57-f933-4aa2-b250-33206df61f58 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:41.506938 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-67fcec57-f933-4aa2-b250-33206df61f58 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:41.507481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-67fcec57-f933-4aa2-b250-33206df61f58 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:41.507975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-67fcec57-f933-4aa2-b250-33206df61f58 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:41.508638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-67fcec57-f933-4aa2-b250-33206df61f58 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:41.509098 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-67fcec57-f933-4aa2-b250-33206df61f58 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:41.509591 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-67fcec57-f933-4aa2-b250-33206df61f58 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:41.514434 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:41.658210 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-67fcec57-f933-4aa2-b250-33206df61f58 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:41.666598 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-67fcec57-f933-4aa2-b250-33206df61f58 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1513 microversion: 2.1 time: 0.171378 Aug 24 16:59:41.667174 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 492/981] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:41 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:41.784618 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-2fc8bbbb-538b-4b37-b169-c35f884f2550 req-dd7bf717-5918-4c34-8c85-e81bcec2b8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dedced4a-76f1-477b-8db0-19cef618a229", "name": "network-vif-deleted", "tag": "898ca7b8-cd5f-448f-bb25-43f8b1ecfb52"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:59:41.794777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-2fc8bbbb-538b-4b37-b169-c35f884f2550 req-dd7bf717-5918-4c34-8c85-e81bcec2b8ef service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:41.795275 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-2fc8bbbb-538b-4b37-b169-c35f884f2550 req-dd7bf717-5918-4c34-8c85-e81bcec2b8ef service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:41.795714 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-2fc8bbbb-538b-4b37-b169-c35f884f2550 req-dd7bf717-5918-4c34-8c85-e81bcec2b8ef service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:41.807143 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-2fc8bbbb-538b-4b37-b169-c35f884f2550 req-dd7bf717-5918-4c34-8c85-e81bcec2b8ef service nova] Creating event network-vif-deleted:898ca7b8-cd5f-448f-bb25-43f8b1ecfb52 for instance dedced4a-76f1-477b-8db0-19cef618a229 on hv-cinder-85220 Aug 24 16:59:41.812029 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-2fc8bbbb-538b-4b37-b169-c35f884f2550 req-dd7bf717-5918-4c34-8c85-e81bcec2b8ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031188 Aug 24 16:59:41.812663 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 490/982] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 16:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:59:42.687879 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:42.688567 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:42.695723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:42.696204 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:42.696661 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:42.697445 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:42.697893 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:42.698310 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:42.731976 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:42.733224 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:42.733515 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:42.733967 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lazy-loading 'fault' on Instance uuid dedced4a-76f1-477b-8db0-19cef618a229 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:59:42.775141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:42.782702 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d0a2e916-4e53-4086-a6ec-4b02f6527e52 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 200 len: 1309 microversion: 2.1 time: 0.099411 Aug 24 16:59:42.783802 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 493/983] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:42 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:43.805475 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e254866c-1232-44b4-81c2-40a839cc99b2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:43.806182 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e254866c-1232-44b4-81c2-40a839cc99b2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: dedced4a-76f1-477b-8db0-19cef618a229] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:43.813039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e254866c-1232-44b4-81c2-40a839cc99b2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:43.813527 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e254866c-1232-44b4-81c2-40a839cc99b2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:43.813962 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e254866c-1232-44b4-81c2-40a839cc99b2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:43.814659 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e254866c-1232-44b4-81c2-40a839cc99b2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:43.815110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e254866c-1232-44b4-81c2-40a839cc99b2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:43.815532 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e254866c-1232-44b4-81c2-40a839cc99b2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:43.830275 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-e254866c-1232-44b4-81c2-40a839cc99b2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] HTTP exception thrown: Instance dedced4a-76f1-477b-8db0-19cef618a229 could not be found. Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e254866c-1232-44b4-81c2-40a839cc99b2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Request method failure captured: Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 HTTP/1.1 Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBliS5W3B5i33JV94KA3klwQ-lBNksO9E-Ag4Hki7r_gRf197VuTtyQllRuahPcJrwC3KzQt0X6N9ZBm9RJjRrqyxygu9Rxejsn1eAaIvtQAp4powY7-EWo45YG_Im2oayolT-KQzuag3tsaL7yW1XnKRD6B0sHl8P9jcjtTvl03Xos0 Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 1088b1d454684ca5be800a99d4e26304 Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1744929539 Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 16:59:43.832008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 16:59:43.833834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1088b1d454684ca5be800a99d4e26304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1088b1d454684ca5be800a99d4e26304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1088b1d454684ca5be800a99d4e26304"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1088b1d454684ca5be800a99d4e26304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 16:59:43.833834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-VolumesSnapshotTestJSON-1744929539 Aug 24 16:59:43.833834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 1088b1d454684ca5be800a99d4e26304 Aug 24 16:59:43.833834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1744929539 Aug 24 16:59:43.833834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-VolumesSnapshotTestJSON-1744929539-project Aug 24 16:59:43.833834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 16:59:43.833834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 16:59:43.833834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: d715cc7828f847529f795f356a8ac16b Aug 24 16:59:43.833834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-VolumesSnapshotTestJSON-1744929539-project Aug 24 16:59:43.833834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 16:59:43.833834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance dedced4a-76f1-477b-8db0-19cef618a229 could not be found. Aug 24 16:59:43.833834 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': 'dedced4a-76f1-477b-8db0-19cef618a229'} Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dedced4a-76f1-477b-8db0-19cef618a229 could not be found. Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:59:43.834750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dedced4a-76f1-477b-8db0-19cef618a229 could not be found. Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dedced4a-76f1-477b-8db0-19cef618a229 could not be found. Aug 24 16:59:43.836142 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 16:59:43.838386 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e254866c-1232-44b4-81c2-40a839cc99b2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Returning 404 to user: Instance dedced4a-76f1-477b-8db0-19cef618a229 could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:59:43.838386 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e254866c-1232-44b4-81c2-40a839cc99b2 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229" status: 404 len: 111 microversion: 2.1 time: 0.032847 Aug 24 16:59:43.838386 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 491/984] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:43 2022] GET /compute/v2.1/servers/dedced4a-76f1-477b-8db0-19cef618a229 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:59:56.493412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1927654351", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "networks": [{"uuid": "9d6175e9-e56e-4df9-8b44-e9e9bea37004"}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:59:56.502277 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=23 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:56.503044 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=12 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:56.549653 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] validate_networks() for [('9d6175e9-e56e-4df9-8b44-e9e9bea37004', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:59:56.752248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-693d0f8d-efce-4c5f-a948-06550e8bfedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:56.756922 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-693d0f8d-efce-4c5f-a948-06550e8bfedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:56.757054 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:56.757823 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:56.762494 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-693d0f8d-efce-4c5f-a948-06550e8bfedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:56.763017 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-693d0f8d-efce-4c5f-a948-06550e8bfedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:56.764075 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-693d0f8d-efce-4c5f-a948-06550e8bfedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:56.764798 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-693d0f8d-efce-4c5f-a948-06550e8bfedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:56.765263 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-693d0f8d-efce-4c5f-a948-06550e8bfedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:56.765690 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-693d0f8d-efce-4c5f-a948-06550e8bfedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:56.797654 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-693d0f8d-efce-4c5f-a948-06550e8bfedd tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049571 Aug 24 16:59:56.798547 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 492/985] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Aug 24 16:59:56 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:59:56.864914 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9dcc4d17-d39b-424a-a993-1968a55fdc5f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:56.865640 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9dcc4d17-d39b-424a-a993-1968a55fdc5f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:56.874710 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9dcc4d17-d39b-424a-a993-1968a55fdc5f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:56.875843 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9dcc4d17-d39b-424a-a993-1968a55fdc5f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:56.875964 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9dcc4d17-d39b-424a-a993-1968a55fdc5f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:56.876700 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9dcc4d17-d39b-424a-a993-1968a55fdc5f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:56.877797 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9dcc4d17-d39b-424a-a993-1968a55fdc5f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:56.877797 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9dcc4d17-d39b-424a-a993-1968a55fdc5f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:56.906435 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9dcc4d17-d39b-424a-a993-1968a55fdc5f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Going to try to terminate instance {{(pid=127715) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:59:56.911190 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:59:56.911759 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:59:56.912528 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:59:56.913012 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:59:56.913490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:59:56.922895 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:56.923435 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:56.923868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:56.928208 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:56.928208 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:56.928208 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:56.943301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Getting quotas for project 1088b1d454684ca5be800a99d4e26304. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:59:56.947445 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Getting quotas for user d715cc7828f847529f795f356a8ac16b and project 1088b1d454684ca5be800a99d4e26304. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:59:56.959179 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:59:56.961564 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:59:57.076079 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d15ee1b2-9d98-4c78-be02-f97d5aa1d8a9 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586393 Aug 24 16:59:57.082599 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 494/986] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 16:59:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:59:57.088676 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b6355d67-d515-4e14-80dd-1a54fb2b6a4a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:57.088676 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b6355d67-d515-4e14-80dd-1a54fb2b6a4a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:57.143099 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b6355d67-d515-4e14-80dd-1a54fb2b6a4a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:57.151026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b6355d67-d515-4e14-80dd-1a54fb2b6a4a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1219 microversion: 2.1 time: 0.067264 Aug 24 16:59:57.151589 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 495/987] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:57 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:57.268720 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9dcc4d17-d39b-424a-a993-1968a55fdc5f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "DELETE /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 204 len: 0 microversion: 2.20 time: 0.408388 Aug 24 16:59:57.269328 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 493/988] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Aug 24 16:59:56 2022] DELETE /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:59:57.283749 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8d29dd09-f198-41f7-9d2e-64f2dada6758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:57.284357 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8d29dd09-f198-41f7-9d2e-64f2dada6758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:57.290551 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8d29dd09-f198-41f7-9d2e-64f2dada6758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:57.291023 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8d29dd09-f198-41f7-9d2e-64f2dada6758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:57.291452 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8d29dd09-f198-41f7-9d2e-64f2dada6758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:57.292134 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8d29dd09-f198-41f7-9d2e-64f2dada6758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:57.292619 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8d29dd09-f198-41f7-9d2e-64f2dada6758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:57.293038 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8d29dd09-f198-41f7-9d2e-64f2dada6758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:57.442084 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8d29dd09-f198-41f7-9d2e-64f2dada6758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:57.450378 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8d29dd09-f198-41f7-9d2e-64f2dada6758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:57.451892 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8d29dd09-f198-41f7-9d2e-64f2dada6758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:57.453091 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8d29dd09-f198-41f7-9d2e-64f2dada6758 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.173333 Aug 24 16:59:57.453859 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 496/989] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:59:57 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:59:58.172873 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-14b56568-899f-4527-8c2d-49ad7724f7d5 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:58.173668 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-14b56568-899f-4527-8c2d-49ad7724f7d5 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:58.179882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-14b56568-899f-4527-8c2d-49ad7724f7d5 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:58.180364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-14b56568-899f-4527-8c2d-49ad7724f7d5 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:58.180826 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-14b56568-899f-4527-8c2d-49ad7724f7d5 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:58.181507 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-14b56568-899f-4527-8c2d-49ad7724f7d5 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:58.181961 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-14b56568-899f-4527-8c2d-49ad7724f7d5 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:58.182379 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-14b56568-899f-4527-8c2d-49ad7724f7d5 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:58.243620 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-14b56568-899f-4527-8c2d-49ad7724f7d5 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:58.251101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-14b56568-899f-4527-8c2d-49ad7724f7d5 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1223 microversion: 2.1 time: 0.083500 Aug 24 16:59:58.251655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 494/990] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:58 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:58.475495 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6be203a9-a431-4861-ab84-b0d2b09d1f27 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:58.476105 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6be203a9-a431-4861-ab84-b0d2b09d1f27 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:58.482530 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6be203a9-a431-4861-ab84-b0d2b09d1f27 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:58.485510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6be203a9-a431-4861-ab84-b0d2b09d1f27 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:58.485510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6be203a9-a431-4861-ab84-b0d2b09d1f27 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:58.485510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6be203a9-a431-4861-ab84-b0d2b09d1f27 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:58.485510 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6be203a9-a431-4861-ab84-b0d2b09d1f27 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:58.485905 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6be203a9-a431-4861-ab84-b0d2b09d1f27 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:58.613839 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6be203a9-a431-4861-ab84-b0d2b09d1f27 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:58.621944 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6be203a9-a431-4861-ab84-b0d2b09d1f27 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:58.623448 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6be203a9-a431-4861-ab84-b0d2b09d1f27 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:58.624639 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6be203a9-a431-4861-ab84-b0d2b09d1f27 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.153123 Aug 24 16:59:58.625197 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 497/991] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:59:58 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:59:59.271781 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ded8cf1d-eef2-4930-84fd-501123ef0c79 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:59.272380 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ded8cf1d-eef2-4930-84fd-501123ef0c79 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:59.279246 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ded8cf1d-eef2-4930-84fd-501123ef0c79 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:59.279725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ded8cf1d-eef2-4930-84fd-501123ef0c79 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:59.280158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ded8cf1d-eef2-4930-84fd-501123ef0c79 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:59.280871 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ded8cf1d-eef2-4930-84fd-501123ef0c79 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:59.281331 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ded8cf1d-eef2-4930-84fd-501123ef0c79 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:59.281770 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ded8cf1d-eef2-4930-84fd-501123ef0c79 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:59.340392 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ded8cf1d-eef2-4930-84fd-501123ef0c79 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:59.348534 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ded8cf1d-eef2-4930-84fd-501123ef0c79 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1223 microversion: 2.1 time: 0.080544 Aug 24 16:59:59.349085 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 495/992] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 16:59:59 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:59:59.648594 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-48d75e41-e38a-4f9d-ae35-aefe373b217c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:59:59.649250 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-48d75e41-e38a-4f9d-ae35-aefe373b217c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:59:59.655772 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48d75e41-e38a-4f9d-ae35-aefe373b217c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:59.656248 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48d75e41-e38a-4f9d-ae35-aefe373b217c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:59.656722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48d75e41-e38a-4f9d-ae35-aefe373b217c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:59.657408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48d75e41-e38a-4f9d-ae35-aefe373b217c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:59:59.657858 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48d75e41-e38a-4f9d-ae35-aefe373b217c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:59:59.658275 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48d75e41-e38a-4f9d-ae35-aefe373b217c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:59:59.789395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-48d75e41-e38a-4f9d-ae35-aefe373b217c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:59.797811 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-48d75e41-e38a-4f9d-ae35-aefe373b217c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:59.799303 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-48d75e41-e38a-4f9d-ae35-aefe373b217c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:59:59.800429 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-48d75e41-e38a-4f9d-ae35-aefe373b217c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.155769 Aug 24 16:59:59.800965 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 498/993] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 16:59:59 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:00:00.369356 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-65c80a77-c000-4937-b7a5-096cdd8fd9a1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:00.369892 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-65c80a77-c000-4937-b7a5-096cdd8fd9a1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:00.376846 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65c80a77-c000-4937-b7a5-096cdd8fd9a1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:00.377328 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65c80a77-c000-4937-b7a5-096cdd8fd9a1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:00.377762 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65c80a77-c000-4937-b7a5-096cdd8fd9a1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:00.378445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65c80a77-c000-4937-b7a5-096cdd8fd9a1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:00.378900 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65c80a77-c000-4937-b7a5-096cdd8fd9a1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:00.379325 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65c80a77-c000-4937-b7a5-096cdd8fd9a1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:00.441477 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-65c80a77-c000-4937-b7a5-096cdd8fd9a1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:00.449036 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-65c80a77-c000-4937-b7a5-096cdd8fd9a1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1223 microversion: 2.1 time: 0.083642 Aug 24 17:00:00.449592 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 496/994] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:00 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:00.823557 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-35a303d0-e8fc-4ab4-bf5b-15f94fe3e0df tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:00.824170 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-35a303d0-e8fc-4ab4-bf5b-15f94fe3e0df tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:00.830553 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-35a303d0-e8fc-4ab4-bf5b-15f94fe3e0df tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:00.831034 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-35a303d0-e8fc-4ab4-bf5b-15f94fe3e0df tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:00.831468 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-35a303d0-e8fc-4ab4-bf5b-15f94fe3e0df tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:00.832151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-35a303d0-e8fc-4ab4-bf5b-15f94fe3e0df tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:00.832634 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-35a303d0-e8fc-4ab4-bf5b-15f94fe3e0df tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:00.833058 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-35a303d0-e8fc-4ab4-bf5b-15f94fe3e0df tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:00.961106 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-35a303d0-e8fc-4ab4-bf5b-15f94fe3e0df tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:00.969143 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-35a303d0-e8fc-4ab4-bf5b-15f94fe3e0df tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:00.970630 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-35a303d0-e8fc-4ab4-bf5b-15f94fe3e0df tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:00.971780 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-35a303d0-e8fc-4ab4-bf5b-15f94fe3e0df tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.152068 Aug 24 17:00:00.972328 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 499/995] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 17:00:00 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:00:01.470088 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-20e2017f-0a2a-461e-9e4d-abee39e4437c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:01.470802 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-20e2017f-0a2a-461e-9e4d-abee39e4437c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:01.477445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20e2017f-0a2a-461e-9e4d-abee39e4437c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:01.478046 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20e2017f-0a2a-461e-9e4d-abee39e4437c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:01.478484 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20e2017f-0a2a-461e-9e4d-abee39e4437c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:01.479170 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20e2017f-0a2a-461e-9e4d-abee39e4437c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:01.479625 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20e2017f-0a2a-461e-9e4d-abee39e4437c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:01.480050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-20e2017f-0a2a-461e-9e4d-abee39e4437c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:01.541027 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-20e2017f-0a2a-461e-9e4d-abee39e4437c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:01.549146 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-20e2017f-0a2a-461e-9e4d-abee39e4437c tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1223 microversion: 2.1 time: 0.082981 Aug 24 17:00:01.550105 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 497/996] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:01 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:01.994803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-40841966-39ef-468b-b09f-c54b0c8f70b5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:01.995414 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-40841966-39ef-468b-b09f-c54b0c8f70b5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:02.001750 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40841966-39ef-468b-b09f-c54b0c8f70b5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:02.002227 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40841966-39ef-468b-b09f-c54b0c8f70b5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:02.002653 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40841966-39ef-468b-b09f-c54b0c8f70b5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:02.003332 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40841966-39ef-468b-b09f-c54b0c8f70b5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:02.003779 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40841966-39ef-468b-b09f-c54b0c8f70b5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:02.004194 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40841966-39ef-468b-b09f-c54b0c8f70b5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:02.129689 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-40841966-39ef-468b-b09f-c54b0c8f70b5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:02.138535 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-40841966-39ef-468b-b09f-c54b0c8f70b5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:02.140025 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-40841966-39ef-468b-b09f-c54b0c8f70b5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:02.141194 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-40841966-39ef-468b-b09f-c54b0c8f70b5 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.150367 Aug 24 17:00:02.141744 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 500/997] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 17:00:01 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:00:02.569831 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-cb54b554-10dd-4982-b4ad-5c4e29164b39 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:02.570454 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-cb54b554-10dd-4982-b4ad-5c4e29164b39 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:02.576886 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb54b554-10dd-4982-b4ad-5c4e29164b39 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:02.577374 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb54b554-10dd-4982-b4ad-5c4e29164b39 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:02.577815 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb54b554-10dd-4982-b4ad-5c4e29164b39 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:02.578509 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb54b554-10dd-4982-b4ad-5c4e29164b39 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:02.578969 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb54b554-10dd-4982-b4ad-5c4e29164b39 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:02.579398 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-cb54b554-10dd-4982-b4ad-5c4e29164b39 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:02.640331 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-cb54b554-10dd-4982-b4ad-5c4e29164b39 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:02.647812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-cb54b554-10dd-4982-b4ad-5c4e29164b39 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1271 microversion: 2.1 time: 0.081819 Aug 24 17:00:02.648372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 498/998] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:02 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:03.164014 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d5965aa7-025e-42f7-bb0f-4b27ba115c4c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:03.164626 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d5965aa7-025e-42f7-bb0f-4b27ba115c4c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:03.171235 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5965aa7-025e-42f7-bb0f-4b27ba115c4c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:03.171719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5965aa7-025e-42f7-bb0f-4b27ba115c4c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:03.172151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5965aa7-025e-42f7-bb0f-4b27ba115c4c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:03.172881 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5965aa7-025e-42f7-bb0f-4b27ba115c4c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:03.173328 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5965aa7-025e-42f7-bb0f-4b27ba115c4c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:03.173746 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5965aa7-025e-42f7-bb0f-4b27ba115c4c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:03.319719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5965aa7-025e-42f7-bb0f-4b27ba115c4c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:03.328644 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5965aa7-025e-42f7-bb0f-4b27ba115c4c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:03.330141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5965aa7-025e-42f7-bb0f-4b27ba115c4c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:03.331499 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d5965aa7-025e-42f7-bb0f-4b27ba115c4c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1723 microversion: 2.20 time: 0.171559 Aug 24 17:00:03.332056 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 501/999] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 17:00:03 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:00:03.674201 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b1924da3-daf1-4733-adeb-34c7ce4178f1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:03.674770 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b1924da3-daf1-4733-adeb-34c7ce4178f1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:03.681275 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b1924da3-daf1-4733-adeb-34c7ce4178f1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:03.681760 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b1924da3-daf1-4733-adeb-34c7ce4178f1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:03.682195 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b1924da3-daf1-4733-adeb-34c7ce4178f1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:03.682891 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b1924da3-daf1-4733-adeb-34c7ce4178f1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:03.683353 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b1924da3-daf1-4733-adeb-34c7ce4178f1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:03.683775 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b1924da3-daf1-4733-adeb-34c7ce4178f1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:03.752454 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b1924da3-daf1-4733-adeb-34c7ce4178f1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:03.760488 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b1924da3-daf1-4733-adeb-34c7ce4178f1 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1277 microversion: 2.1 time: 0.090861 Aug 24 17:00:03.761060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 499/1000] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:03 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:04.354986 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0104a7cb-b160-4455-b1e2-65f6841df48c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:04.355804 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0104a7cb-b160-4455-b1e2-65f6841df48c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:04.363970 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0104a7cb-b160-4455-b1e2-65f6841df48c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:04.364864 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0104a7cb-b160-4455-b1e2-65f6841df48c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:04.365360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0104a7cb-b160-4455-b1e2-65f6841df48c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:04.366060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0104a7cb-b160-4455-b1e2-65f6841df48c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:04.366557 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0104a7cb-b160-4455-b1e2-65f6841df48c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:04.366986 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0104a7cb-b160-4455-b1e2-65f6841df48c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:04.452844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0104a7cb-b160-4455-b1e2-65f6841df48c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:04.469447 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0104a7cb-b160-4455-b1e2-65f6841df48c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:04.471813 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0104a7cb-b160-4455-b1e2-65f6841df48c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:04.473226 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0104a7cb-b160-4455-b1e2-65f6841df48c tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1656 microversion: 2.20 time: 0.122906 Aug 24 17:00:04.474324 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 502/1001] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 17:00:04 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1656 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:00:04.791060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-31a90db4-a0ee-492e-b8da-44e1739fc1ba tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:04.793296 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-31a90db4-a0ee-492e-b8da-44e1739fc1ba tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:04.800790 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-31a90db4-a0ee-492e-b8da-44e1739fc1ba tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:04.801575 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-31a90db4-a0ee-492e-b8da-44e1739fc1ba tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:04.802093 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-31a90db4-a0ee-492e-b8da-44e1739fc1ba tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:04.802896 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-31a90db4-a0ee-492e-b8da-44e1739fc1ba tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:04.803586 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-31a90db4-a0ee-492e-b8da-44e1739fc1ba tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:04.804225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-31a90db4-a0ee-492e-b8da-44e1739fc1ba tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:04.948223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-fdb2ee85-ba41-440c-838a-e4dce802a8d0 req-8558218e-2883-4e35-b64d-668f9b26d502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d1714b-1531-428f-a205-e42cedf76d9b", "name": "network-vif-deleted", "tag": "629e65e7-9a31-4acf-8a66-2220e5591487"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:00:04.961121 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-fdb2ee85-ba41-440c-838a-e4dce802a8d0 req-8558218e-2883-4e35-b64d-668f9b26d502 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:04.961887 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-fdb2ee85-ba41-440c-838a-e4dce802a8d0 req-8558218e-2883-4e35-b64d-668f9b26d502 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:04.962664 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-fdb2ee85-ba41-440c-838a-e4dce802a8d0 req-8558218e-2883-4e35-b64d-668f9b26d502 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:04.971045 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-31a90db4-a0ee-492e-b8da-44e1739fc1ba tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:04.976077 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-31a90db4-a0ee-492e-b8da-44e1739fc1ba tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1319 microversion: 2.1 time: 0.196426 Aug 24 17:00:04.979123 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-fdb2ee85-ba41-440c-838a-e4dce802a8d0 req-8558218e-2883-4e35-b64d-668f9b26d502 service nova] Creating event network-vif-deleted:629e65e7-9a31-4acf-8a66-2220e5591487 for instance 09d1714b-1531-428f-a205-e42cedf76d9b on hv-cinder-85220 Aug 24 17:00:04.985538 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-fdb2ee85-ba41-440c-838a-e4dce802a8d0 req-8558218e-2883-4e35-b64d-668f9b26d502 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199614 Aug 24 17:00:04.987452 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 503/1002] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:00:04.987974 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 500/1003] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:04 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:05.499648 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:05.500479 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:05.508284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:05.509153 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:05.509850 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:05.510835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:05.511515 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:05.512113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:05.558039 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:05.558381 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:05.563356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:05.563877 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lazy-loading 'fault' on Instance uuid 09d1714b-1531-428f-a205-e42cedf76d9b {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:00:05.610059 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:05.619175 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:05.620990 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a930257a6584b04bae278aa83940264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525245253a2d49c48ef009a4d6c3cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:05.622864 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c5acf281-2203-44d4-ace1-47882bcbb67f tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 200 len: 1372 microversion: 2.20 time: 0.128347 Aug 24 17:00:05.623513 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 504/1004] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 17:00:05 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 1372 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:00:05.999923 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b68ea572-3908-406f-b4cc-464fa9988fc8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:06.000616 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b68ea572-3908-406f-b4cc-464fa9988fc8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:06.009279 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b68ea572-3908-406f-b4cc-464fa9988fc8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:06.011525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b68ea572-3908-406f-b4cc-464fa9988fc8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:06.011525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b68ea572-3908-406f-b4cc-464fa9988fc8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:06.011525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b68ea572-3908-406f-b4cc-464fa9988fc8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:06.011525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b68ea572-3908-406f-b4cc-464fa9988fc8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:06.011977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b68ea572-3908-406f-b4cc-464fa9988fc8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:06.144792 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b68ea572-3908-406f-b4cc-464fa9988fc8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:06.152367 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b68ea572-3908-406f-b4cc-464fa9988fc8 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1319 microversion: 2.1 time: 0.157354 Aug 24 17:00:06.152953 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 501/1005] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:05 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:06.646354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2383bd55-e3e8-41ed-a3c9-9cbf3263bf1d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:06.646962 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2383bd55-e3e8-41ed-a3c9-9cbf3263bf1d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:06.653344 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2383bd55-e3e8-41ed-a3c9-9cbf3263bf1d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:06.653932 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2383bd55-e3e8-41ed-a3c9-9cbf3263bf1d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:06.654964 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2383bd55-e3e8-41ed-a3c9-9cbf3263bf1d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:06.655851 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2383bd55-e3e8-41ed-a3c9-9cbf3263bf1d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:06.656320 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2383bd55-e3e8-41ed-a3c9-9cbf3263bf1d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:06.657264 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2383bd55-e3e8-41ed-a3c9-9cbf3263bf1d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:06.670928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-2383bd55-e3e8-41ed-a3c9-9cbf3263bf1d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] HTTP exception thrown: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2383bd55-e3e8-41ed-a3c9-9cbf3263bf1d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Request method failure captured: Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b HTTP/1.1 Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZIhr_tQl-FTbFiyNprlO4a6lKjXiWGrd3wNwayCJKIjOaIVm0DC5kqqAaS76RQJN2HsYKEXLdCg9q1Z_cHpw13WUmGkfO5QkYG0dys3ww6K3KGwOB1lv3LoDLq-Z-oZ2oCnqaL3x7k3LIAVD0s8SN4hZOljeUBdbbmLmCHWuW8BXA Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 525245253a2d49c48ef009a4d6c3cd51 Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 17:00:06.672596 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 17:00:06.674305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:00:06.674305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:06.674305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 525245253a2d49c48ef009a4d6c3cd51 Aug 24 17:00:06.674305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:06.674305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-AttachVolumeShelveTestJSON-1732562792-project Aug 24 17:00:06.674305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 17:00:06.674305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 17:00:06.674305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 7a930257a6584b04bae278aa83940264 Aug 24 17:00:06.674305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1732562792-project Aug 24 17:00:06.674305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 17:00:06.674305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:06.674305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '09d1714b-1531-428f-a205-e42cedf76d9b'} Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:00:06.675253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:06.676810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:06.678121 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2383bd55-e3e8-41ed-a3c9-9cbf3263bf1d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Returning 404 to user: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:00:06.678121 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2383bd55-e3e8-41ed-a3c9-9cbf3263bf1d tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 404 len: 111 microversion: 2.20 time: 0.031635 Aug 24 17:00:06.678121 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 505/1006] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 17:00:06 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:00:06.682924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d38b3cd6-9ee8-469f-867f-7c3403a00d92 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '.version_select at 0x7fa194883d30>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:06.777802 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d38b3cd6-9ee8-469f-867f-7c3403a00d92 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522251124" status: 204 len: 0 microversion: 2.20 time: 0.098519 Aug 24 17:00:06.778314 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 502/1007] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Aug 24 17:00:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522251124 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:00:07.015549 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-96496f5e-0811-46e3-8e13-d84fba875431 req-cad06fa2-f154-4b44-9586-717d2034605f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e266f10-7f28-4301-bccf-43e4e4c0a50e", "tag": "a9baabb8-dd3f-40cd-bbe5-bf54f463ff6c"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:00:07.020284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:07.025716 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-96496f5e-0811-46e3-8e13-d84fba875431 req-cad06fa2-f154-4b44-9586-717d2034605f service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:07.026187 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-96496f5e-0811-46e3-8e13-d84fba875431 req-cad06fa2-f154-4b44-9586-717d2034605f service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:07.026721 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-96496f5e-0811-46e3-8e13-d84fba875431 req-cad06fa2-f154-4b44-9586-717d2034605f service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:07.038597 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-96496f5e-0811-46e3-8e13-d84fba875431 req-cad06fa2-f154-4b44-9586-717d2034605f service nova] Creating event network-changed:a9baabb8-dd3f-40cd-bbe5-bf54f463ff6c for instance 8e266f10-7f28-4301-bccf-43e4e4c0a50e on hv-cinder-85220 Aug 24 17:00:07.044650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-96496f5e-0811-46e3-8e13-d84fba875431 req-cad06fa2-f154-4b44-9586-717d2034605f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032055 Aug 24 17:00:07.048921 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 506/1008] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:00:07.177101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fd7a9945-1712-41cd-b36d-b9681ad95b85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:07.177779 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fd7a9945-1712-41cd-b36d-b9681ad95b85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:07.183833 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd7a9945-1712-41cd-b36d-b9681ad95b85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:07.184320 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd7a9945-1712-41cd-b36d-b9681ad95b85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:07.184789 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd7a9945-1712-41cd-b36d-b9681ad95b85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:07.185480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd7a9945-1712-41cd-b36d-b9681ad95b85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:07.185930 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd7a9945-1712-41cd-b36d-b9681ad95b85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:07.186366 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd7a9945-1712-41cd-b36d-b9681ad95b85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:07.379532 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fd7a9945-1712-41cd-b36d-b9681ad95b85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:07.388268 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fd7a9945-1712-41cd-b36d-b9681ad95b85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1319 microversion: 2.1 time: 0.216796 Aug 24 17:00:07.389127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 503/1009] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:07 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:08.406421 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=8 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:08.411284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2dc658e9-ef69-41ca-a816-8aacb2e50d85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:08.411984 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2dc658e9-ef69-41ca-a816-8aacb2e50d85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:08.418353 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dc658e9-ef69-41ca-a816-8aacb2e50d85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:08.418840 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dc658e9-ef69-41ca-a816-8aacb2e50d85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:08.419275 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dc658e9-ef69-41ca-a816-8aacb2e50d85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:08.419963 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dc658e9-ef69-41ca-a816-8aacb2e50d85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:08.420434 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dc658e9-ef69-41ca-a816-8aacb2e50d85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:08.420904 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dc658e9-ef69-41ca-a816-8aacb2e50d85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:08.557784 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2dc658e9-ef69-41ca-a816-8aacb2e50d85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:08.563456 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2dc658e9-ef69-41ca-a816-8aacb2e50d85 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1319 microversion: 2.1 time: 0.157862 Aug 24 17:00:08.564549 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 507/1010] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:08 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:08.897970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-62e734fd-a203-43c9-a9a1-6722e0539831 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:08.898562 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-62e734fd-a203-43c9-a9a1-6722e0539831 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:08.905927 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-62e734fd-a203-43c9-a9a1-6722e0539831 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:08.906428 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-62e734fd-a203-43c9-a9a1-6722e0539831 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:08.906952 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-62e734fd-a203-43c9-a9a1-6722e0539831 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:08.907596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-62e734fd-a203-43c9-a9a1-6722e0539831 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:08.908052 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-62e734fd-a203-43c9-a9a1-6722e0539831 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:08.908516 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-62e734fd-a203-43c9-a9a1-6722e0539831 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:08.925927 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-62e734fd-a203-43c9-a9a1-6722e0539831 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] HTTP exception thrown: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-62e734fd-a203-43c9-a9a1-6722e0539831 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Request method failure captured: Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: DELETE /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b HTTP/1.1 Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZIhr_tQl-FTbFiyNprlO4a6lKjXiWGrd3wNwayCJKIjOaIVm0DC5kqqAaS76RQJN2HsYKEXLdCg9q1Z_cHpw13WUmGkfO5QkYG0dys3ww6K3KGwOB1lv3LoDLq-Z-oZ2oCnqaL3x7k3LIAVD0s8SN4hZOljeUBdbbmLmCHWuW8BXA Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 525245253a2d49c48ef009a4d6c3cd51 Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 17:00:08.927635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 17:00:08.933283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:00:08.933283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:08.933283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 525245253a2d49c48ef009a4d6c3cd51 Aug 24 17:00:08.933283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:08.933283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-AttachVolumeShelveTestJSON-1732562792-project Aug 24 17:00:08.933283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 17:00:08.933283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 17:00:08.933283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 7a930257a6584b04bae278aa83940264 Aug 24 17:00:08.933283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1732562792-project Aug 24 17:00:08.933283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 17:00:08.933283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:08.933283 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '09d1714b-1531-428f-a205-e42cedf76d9b'} Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:00:08.934266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:08.935907 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:00:08.939610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-62e734fd-a203-43c9-a9a1-6722e0539831 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Returning 404 to user: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:00:08.939610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-62e734fd-a203-43c9-a9a1-6722e0539831 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "DELETE /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 404 len: 111 microversion: 2.20 time: 0.035139 Aug 24 17:00:08.939610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 504/1011] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Aug 24 17:00:08 2022] DELETE /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 17:00:08.941331 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-68370bc7-c020-4212-af3a-25806d846989 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:08.942028 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-68370bc7-c020-4212-af3a-25806d846989 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 09d1714b-1531-428f-a205-e42cedf76d9b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:08.948511 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68370bc7-c020-4212-af3a-25806d846989 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:08.949087 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68370bc7-c020-4212-af3a-25806d846989 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:08.950052 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68370bc7-c020-4212-af3a-25806d846989 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:08.950486 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68370bc7-c020-4212-af3a-25806d846989 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:08.950898 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68370bc7-c020-4212-af3a-25806d846989 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:08.951867 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68370bc7-c020-4212-af3a-25806d846989 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:08.965318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-68370bc7-c020-4212-af3a-25806d846989 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] HTTP exception thrown: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-68370bc7-c020-4212-af3a-25806d846989 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Request method failure captured: Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b HTTP/1.1 Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZIhr_tQl-FTbFiyNprlO4a6lKjXiWGrd3wNwayCJKIjOaIVm0DC5kqqAaS76RQJN2HsYKEXLdCg9q1Z_cHpw13WUmGkfO5QkYG0dys3ww6K3KGwOB1lv3LoDLq-Z-oZ2oCnqaL3x7k3LIAVD0s8SN4hZOljeUBdbbmLmCHWuW8BXA Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 525245253a2d49c48ef009a4d6c3cd51 Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 17:00:08.967681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 17:00:08.969695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:00:08.969695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:08.969695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 525245253a2d49c48ef009a4d6c3cd51 Aug 24 17:00:08.969695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:08.969695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-AttachVolumeShelveTestJSON-1732562792-project Aug 24 17:00:08.969695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 17:00:08.969695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 17:00:08.969695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 7a930257a6584b04bae278aa83940264 Aug 24 17:00:08.969695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1732562792-project Aug 24 17:00:08.969695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 17:00:08.969695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:08.969695 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '09d1714b-1531-428f-a205-e42cedf76d9b'} Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:00:08.973651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. Aug 24 17:00:08.975301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:08.976720 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-68370bc7-c020-4212-af3a-25806d846989 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Returning 404 to user: Instance 09d1714b-1531-428f-a205-e42cedf76d9b could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:00:08.976720 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-68370bc7-c020-4212-af3a-25806d846989 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b" status: 404 len: 111 microversion: 2.20 time: 0.036137 Aug 24 17:00:08.976720 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 508/1012] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 17:00:08 2022] GET /compute/v2.1/servers/09d1714b-1531-428f-a205-e42cedf76d9b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 17:00:09.584272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e2923a2f-4ea3-4ec2-99c6-a2deb29150a3 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:09.584917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e2923a2f-4ea3-4ec2-99c6-a2deb29150a3 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:09.591465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e2923a2f-4ea3-4ec2-99c6-a2deb29150a3 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:09.592170 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e2923a2f-4ea3-4ec2-99c6-a2deb29150a3 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:09.592636 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e2923a2f-4ea3-4ec2-99c6-a2deb29150a3 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:09.593838 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e2923a2f-4ea3-4ec2-99c6-a2deb29150a3 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:09.594293 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e2923a2f-4ea3-4ec2-99c6-a2deb29150a3 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:09.599808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e2923a2f-4ea3-4ec2-99c6-a2deb29150a3 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:09.725950 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e2923a2f-4ea3-4ec2-99c6-a2deb29150a3 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:09.734810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e2923a2f-4ea3-4ec2-99c6-a2deb29150a3 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1319 microversion: 2.1 time: 0.154340 Aug 24 17:00:09.746385 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 505/1013] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:09 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:10.262565 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce41d202-a779-4426-b26f-9b6ae71d79b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:10.263139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ce41d202-a779-4426-b26f-9b6ae71d79b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:10.269877 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce41d202-a779-4426-b26f-9b6ae71d79b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:10.270364 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce41d202-a779-4426-b26f-9b6ae71d79b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:10.270799 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce41d202-a779-4426-b26f-9b6ae71d79b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:10.271506 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce41d202-a779-4426-b26f-9b6ae71d79b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:10.271960 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce41d202-a779-4426-b26f-9b6ae71d79b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:10.272384 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce41d202-a779-4426-b26f-9b6ae71d79b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:10.287617 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-ce41d202-a779-4426-b26f-9b6ae71d79b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] HTTP exception thrown: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce41d202-a779-4426-b26f-9b6ae71d79b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Request method failure captured: Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: DELETE /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb HTTP/1.1 Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlZIhr_tQl-FTbFiyNprlO4a6lKjXiWGrd3wNwayCJKIjOaIVm0DC5kqqAaS76RQJN2HsYKEXLdCg9q1Z_cHpw13WUmGkfO5QkYG0dys3ww6K3KGwOB1lv3LoDLq-Z-oZ2oCnqaL3x7k3LIAVD0s8SN4hZOljeUBdbbmLmCHWuW8BXA Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 525245253a2d49c48ef009a4d6c3cd51 Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 17:00:10.289225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 17:00:10.290939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:00:10.290939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:10.290939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 525245253a2d49c48ef009a4d6c3cd51 Aug 24 17:00:10.290939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:10.290939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-AttachVolumeShelveTestJSON-1732562792-project Aug 24 17:00:10.290939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 17:00:10.290939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 17:00:10.290939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 7a930257a6584b04bae278aa83940264 Aug 24 17:00:10.290939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1732562792-project Aug 24 17:00:10.290939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 17:00:10.290939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 17:00:10.290939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '6d2cca9b-5df9-43a4-9791-633eab746eeb'} Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:00:10.291946 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 17:00:10.293271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:00:10.295454 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce41d202-a779-4426-b26f-9b6ae71d79b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Returning 404 to user: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:00:10.295454 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ce41d202-a779-4426-b26f-9b6ae71d79b4 tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 404 len: 111 microversion: 2.20 time: 0.031970 Aug 24 17:00:10.295454 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 509/1014] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Aug 24 17:00:10 2022] DELETE /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:00:10.300895 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-abe2c261-8df4-4ddd-84d7-cbda9dedd67b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:10.301507 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-abe2c261-8df4-4ddd-84d7-cbda9dedd67b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] [instance: 6d2cca9b-5df9-43a4-9791-633eab746eeb] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:10.308218 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-abe2c261-8df4-4ddd-84d7-cbda9dedd67b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:10.308747 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-abe2c261-8df4-4ddd-84d7-cbda9dedd67b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:10.309189 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-abe2c261-8df4-4ddd-84d7-cbda9dedd67b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:10.309898 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-abe2c261-8df4-4ddd-84d7-cbda9dedd67b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:10.310357 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-abe2c261-8df4-4ddd-84d7-cbda9dedd67b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:10.310847 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-abe2c261-8df4-4ddd-84d7-cbda9dedd67b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:10.324793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-abe2c261-8df4-4ddd-84d7-cbda9dedd67b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] HTTP exception thrown: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-abe2c261-8df4-4ddd-84d7-cbda9dedd67b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Request method failure captured: Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb HTTP/1.1 Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlZIhr_tQl-FTbFiyNprlO4a6lKjXiWGrd3wNwayCJKIjOaIVm0DC5kqqAaS76RQJN2HsYKEXLdCg9q1Z_cHpw13WUmGkfO5QkYG0dys3ww6K3KGwOB1lv3LoDLq-Z-oZ2oCnqaL3x7k3LIAVD0s8SN4hZOljeUBdbbmLmCHWuW8BXA Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 525245253a2d49c48ef009a4d6c3cd51 Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 17:00:10.326343 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 17:00:10.328095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/525245253a2d49c48ef009a4d6c3cd51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:00:10.328095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:10.328095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 525245253a2d49c48ef009a4d6c3cd51 Aug 24 17:00:10.328095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1732562792 Aug 24 17:00:10.328095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-AttachVolumeShelveTestJSON-1732562792-project Aug 24 17:00:10.328095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 17:00:10.328095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 17:00:10.328095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 7a930257a6584b04bae278aa83940264 Aug 24 17:00:10.328095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1732562792-project Aug 24 17:00:10.328095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 17:00:10.328095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 17:00:10.328095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '6d2cca9b-5df9-43a4-9791-633eab746eeb'} Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:00:10.329209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. Aug 24 17:00:10.330696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:00:10.332147 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-abe2c261-8df4-4ddd-84d7-cbda9dedd67b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] Returning 404 to user: Instance 6d2cca9b-5df9-43a4-9791-633eab746eeb could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:00:10.332147 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-abe2c261-8df4-4ddd-84d7-cbda9dedd67b tempest-AttachVolumeShelveTestJSON-1732562792 tempest-AttachVolumeShelveTestJSON-1732562792-project] 10.222.0.70 "GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb" status: 404 len: 111 microversion: 2.20 time: 0.030822 Aug 24 17:00:10.332147 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 506/1015] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Aug 24 17:00:10 2022] GET /compute/v2.1/servers/6d2cca9b-5df9-43a4-9791-633eab746eeb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:00:10.774093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-78aa7bfd-77a9-4622-979a-e5c5cb87224f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:10.774093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-78aa7bfd-77a9-4622-979a-e5c5cb87224f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:10.774093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-78aa7bfd-77a9-4622-979a-e5c5cb87224f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:10.774093 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-78aa7bfd-77a9-4622-979a-e5c5cb87224f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:10.774563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-78aa7bfd-77a9-4622-979a-e5c5cb87224f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:10.774563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-78aa7bfd-77a9-4622-979a-e5c5cb87224f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:10.774563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-78aa7bfd-77a9-4622-979a-e5c5cb87224f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:10.774563 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-78aa7bfd-77a9-4622-979a-e5c5cb87224f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:11.155171 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-78aa7bfd-77a9-4622-979a-e5c5cb87224f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:11.163357 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-78aa7bfd-77a9-4622-979a-e5c5cb87224f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1319 microversion: 2.1 time: 0.411946 Aug 24 17:00:11.179699 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 510/1016] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:10 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:11.428955 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-1b31223b-8746-4076-9bd8-8d4f75abac73 req-b99d965b-1a55-4e1a-aa9a-cd29479d279a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e266f10-7f28-4301-bccf-43e4e4c0a50e", "name": "network-vif-plugged", "status": "completed", "tag": "a9baabb8-dd3f-40cd-bbe5-bf54f463ff6c"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:00:11.442049 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-1b31223b-8746-4076-9bd8-8d4f75abac73 req-b99d965b-1a55-4e1a-aa9a-cd29479d279a service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:11.442572 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-1b31223b-8746-4076-9bd8-8d4f75abac73 req-b99d965b-1a55-4e1a-aa9a-cd29479d279a service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:11.443026 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-1b31223b-8746-4076-9bd8-8d4f75abac73 req-b99d965b-1a55-4e1a-aa9a-cd29479d279a service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:11.454285 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-1b31223b-8746-4076-9bd8-8d4f75abac73 req-b99d965b-1a55-4e1a-aa9a-cd29479d279a service nova] Creating event network-vif-plugged:a9baabb8-dd3f-40cd-bbe5-bf54f463ff6c for instance 8e266f10-7f28-4301-bccf-43e4e4c0a50e on hv-cinder-85220 Aug 24 17:00:11.459622 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-1b31223b-8746-4076-9bd8-8d4f75abac73 req-b99d965b-1a55-4e1a-aa9a-cd29479d279a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035783 Aug 24 17:00:11.460248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 507/1017] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:00:12.186141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a4842694-a327-4866-bae8-d9a01aae75e0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:12.186910 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a4842694-a327-4866-bae8-d9a01aae75e0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:12.195880 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4842694-a327-4866-bae8-d9a01aae75e0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:12.196551 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4842694-a327-4866-bae8-d9a01aae75e0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:12.197280 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4842694-a327-4866-bae8-d9a01aae75e0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:12.198304 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4842694-a327-4866-bae8-d9a01aae75e0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:12.198978 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4842694-a327-4866-bae8-d9a01aae75e0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:12.199641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4842694-a327-4866-bae8-d9a01aae75e0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:12.381292 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a4842694-a327-4866-bae8-d9a01aae75e0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:12.396011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a4842694-a327-4866-bae8-d9a01aae75e0 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1319 microversion: 2.1 time: 0.213644 Aug 24 17:00:12.397585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 511/1018] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:12 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:13.421082 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9e049bd2-e57f-4154-8824-665045ed33af tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:13.421782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9e049bd2-e57f-4154-8824-665045ed33af tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:13.428153 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e049bd2-e57f-4154-8824-665045ed33af tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:13.428725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e049bd2-e57f-4154-8824-665045ed33af tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:13.429273 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e049bd2-e57f-4154-8824-665045ed33af tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:13.430109 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e049bd2-e57f-4154-8824-665045ed33af tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:13.430596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e049bd2-e57f-4154-8824-665045ed33af tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:13.431017 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e049bd2-e57f-4154-8824-665045ed33af tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:13.581870 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9e049bd2-e57f-4154-8824-665045ed33af tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:13.590475 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9e049bd2-e57f-4154-8824-665045ed33af tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1319 microversion: 2.1 time: 0.174949 Aug 24 17:00:13.607702 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 508/1019] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:13 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:14.615206 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c2befab9-b085-4018-a2fe-a9244d729f20 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:14.615868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c2befab9-b085-4018-a2fe-a9244d729f20 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:14.623663 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2befab9-b085-4018-a2fe-a9244d729f20 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:14.624336 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2befab9-b085-4018-a2fe-a9244d729f20 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:14.625016 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2befab9-b085-4018-a2fe-a9244d729f20 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:14.625789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2befab9-b085-4018-a2fe-a9244d729f20 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:14.626506 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2befab9-b085-4018-a2fe-a9244d729f20 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:14.627131 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2befab9-b085-4018-a2fe-a9244d729f20 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:14.828556 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c2befab9-b085-4018-a2fe-a9244d729f20 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:14.836437 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c2befab9-b085-4018-a2fe-a9244d729f20 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1507 microversion: 2.1 time: 0.225904 Aug 24 17:00:14.837007 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 512/1020] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:14 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:14.858486 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c6eda946-4915-4eb3-aca7-a901fbc02780 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b21e55fc-a334-4997-8dff-5df9a6e4fa80", "device": "/dev/sdb"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:00:14.861637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c6eda946-4915-4eb3-aca7-a901fbc02780 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:14.868722 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6eda946-4915-4eb3-aca7-a901fbc02780 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:14.869209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6eda946-4915-4eb3-aca7-a901fbc02780 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:14.869859 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6eda946-4915-4eb3-aca7-a901fbc02780 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:14.870561 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6eda946-4915-4eb3-aca7-a901fbc02780 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:14.871020 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6eda946-4915-4eb3-aca7-a901fbc02780 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:14.871445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c6eda946-4915-4eb3-aca7-a901fbc02780 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:14.963995 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:15.798588 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c6eda946-4915-4eb3-aca7-a901fbc02780 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "POST /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.945148 Aug 24 17:00:15.801199 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 509/1021] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 17:00:14 2022] POST /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e/os-volume_attachments => generated 194 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:00:22.847802 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3f44f5eb-23ed-41a5-b625-7486db23d319 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Action: 'create', calling method: .version_select at 0x7fa1991fc040>, body: {"keypair": {"name": "tempest-keypair-878298705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUIntqsbEZv/iRN+LXz1R8sKhLujbmFfFX3nUPczm8cYDtxWnb0I3KppY2S70tvyXz8YDM2aRzFw6zpt9oPqFfuR0z59JdDB0Vb0pSrwlpY8aqo/xJr8GGqcGyysM5/cQ=="}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:00:22.864335 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-3f44f5eb-23ed-41a5-b625-7486db23d319 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Getting quotas for project 19ac17f7efa644819e75576a06bb2499. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:00:22.868555 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-3f44f5eb-23ed-41a5-b625-7486db23d319 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Getting quotas for user 9d1076aed12f4d22a34df10ed0d8e462 and project 19ac17f7efa644819e75576a06bb2499. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:00:22.951561 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3f44f5eb-23ed-41a5-b625-7486db23d319 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.366740 Aug 24 17:00:22.952630 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 513/1022] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Aug 24 17:00:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:00:25.276261 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:25.281172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1595421574", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd5a5747-bc49-4240-ae73-1ffb40faec77"}], "security_groups": [{"name": "tempest-securitygroup--15176499"}], "key_name": "tempest-keypair-878298705", "user_data": "}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:00:25.390178 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.network.neutron [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] validate_networks() for [('dd5a5747-bc49-4240-ae73-1ffb40faec77', None, None, None, None, None)] {{(pid=127715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:00:25.707391 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:25.927662 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Flavor limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:00:25.928083 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Image limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:00:25.928592 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Flavor pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:00:25.929473 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Image pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:00:25.930054 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:00:25.940873 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:25.941296 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:25.941727 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:25.942462 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:25.942915 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:25.943333 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:25.961761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Getting quotas for project 19ac17f7efa644819e75576a06bb2499. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:00:25.967757 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Getting quotas for user 9d1076aed12f4d22a34df10ed0d8e462 and project 19ac17f7efa644819e75576a06bb2499. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:00:25.984665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Going to run 1 instances... {{(pid=127715) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:00:25.987505 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:00:26.142335 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-eab215a9-85f9-4813-90c1-bf3c367b0a2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.867591 Aug 24 17:00:26.143664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 510/1023] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 17:00:25 2022] POST /compute/v2.1/servers => generated 400 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:00:26.154797 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0e22df22-98d1-4d34-9700-842c9bd7d832 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:26.155464 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0e22df22-98d1-4d34-9700-842c9bd7d832 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:26.158513 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=86 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:26.222379 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0e22df22-98d1-4d34-9700-842c9bd7d832 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:26.230544 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0e22df22-98d1-4d34-9700-842c9bd7d832 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1237 microversion: 2.1 time: 0.080166 Aug 24 17:00:26.231656 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 514/1024] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:26 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:27.252019 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ab60830a-5e24-4f0d-b31d-6663867cb85f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:27.252669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ab60830a-5e24-4f0d-b31d-6663867cb85f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:27.259934 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab60830a-5e24-4f0d-b31d-6663867cb85f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:27.260457 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab60830a-5e24-4f0d-b31d-6663867cb85f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:27.260884 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab60830a-5e24-4f0d-b31d-6663867cb85f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:27.261554 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab60830a-5e24-4f0d-b31d-6663867cb85f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:27.262004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab60830a-5e24-4f0d-b31d-6663867cb85f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:27.262426 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ab60830a-5e24-4f0d-b31d-6663867cb85f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:27.321192 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ab60830a-5e24-4f0d-b31d-6663867cb85f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:27.328644 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ab60830a-5e24-4f0d-b31d-6663867cb85f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1241 microversion: 2.1 time: 0.080883 Aug 24 17:00:27.329195 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 511/1025] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:27 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:28.349080 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0c5a3e1a-b8f1-467a-a775-30fdc78ab33c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:28.349671 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0c5a3e1a-b8f1-467a-a775-30fdc78ab33c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:28.351759 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:28.357315 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c5a3e1a-b8f1-467a-a775-30fdc78ab33c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:28.357793 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c5a3e1a-b8f1-467a-a775-30fdc78ab33c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:28.358220 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c5a3e1a-b8f1-467a-a775-30fdc78ab33c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:28.358912 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c5a3e1a-b8f1-467a-a775-30fdc78ab33c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:28.359362 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c5a3e1a-b8f1-467a-a775-30fdc78ab33c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:28.359783 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c5a3e1a-b8f1-467a-a775-30fdc78ab33c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:28.427038 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0c5a3e1a-b8f1-467a-a775-30fdc78ab33c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:28.434939 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0c5a3e1a-b8f1-467a-a775-30fdc78ab33c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1289 microversion: 2.1 time: 0.089765 Aug 24 17:00:28.435499 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 515/1026] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:28 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:29.455154 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3481d4bf-d8dc-4e10-94e0-0a195989d615 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:29.461846 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3481d4bf-d8dc-4e10-94e0-0a195989d615 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:29.463440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3481d4bf-d8dc-4e10-94e0-0a195989d615 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:29.464060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3481d4bf-d8dc-4e10-94e0-0a195989d615 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:29.464608 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3481d4bf-d8dc-4e10-94e0-0a195989d615 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:29.465442 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3481d4bf-d8dc-4e10-94e0-0a195989d615 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:29.466022 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3481d4bf-d8dc-4e10-94e0-0a195989d615 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:29.466515 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3481d4bf-d8dc-4e10-94e0-0a195989d615 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:29.536638 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3481d4bf-d8dc-4e10-94e0-0a195989d615 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:29.544881 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3481d4bf-d8dc-4e10-94e0-0a195989d615 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1295 microversion: 2.1 time: 0.093556 Aug 24 17:00:29.545466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 512/1027] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:29 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1295 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:30.570509 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5326e011-1459-413e-a139-b4d01e1354ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:30.571044 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5326e011-1459-413e-a139-b4d01e1354ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:30.578257 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5326e011-1459-413e-a139-b4d01e1354ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:30.578737 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5326e011-1459-413e-a139-b4d01e1354ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:30.579168 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5326e011-1459-413e-a139-b4d01e1354ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:30.579860 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5326e011-1459-413e-a139-b4d01e1354ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:30.580310 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5326e011-1459-413e-a139-b4d01e1354ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:30.580768 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5326e011-1459-413e-a139-b4d01e1354ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:30.674993 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-f7fbaa41-c9a4-4114-8b1b-dcf586428022 req-c309c7cc-0a39-4385-bfec-668f52274a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f799b07-9fb4-4890-841d-d4621c0a6980", "tag": "e716512b-6e25-445c-a0e9-754d2f1c4c8c"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:00:30.685738 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f7fbaa41-c9a4-4114-8b1b-dcf586428022 req-c309c7cc-0a39-4385-bfec-668f52274a8b service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:30.686221 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f7fbaa41-c9a4-4114-8b1b-dcf586428022 req-c309c7cc-0a39-4385-bfec-668f52274a8b service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:30.686660 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f7fbaa41-c9a4-4114-8b1b-dcf586428022 req-c309c7cc-0a39-4385-bfec-668f52274a8b service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:30.699054 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-f7fbaa41-c9a4-4114-8b1b-dcf586428022 req-c309c7cc-0a39-4385-bfec-668f52274a8b service nova] Creating event network-changed:e716512b-6e25-445c-a0e9-754d2f1c4c8c for instance 4f799b07-9fb4-4890-841d-d4621c0a6980 on hv-cinder-85220 Aug 24 17:00:30.704600 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-f7fbaa41-c9a4-4114-8b1b-dcf586428022 req-c309c7cc-0a39-4385-bfec-668f52274a8b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033485 Aug 24 17:00:30.705203 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 513/1028] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:00:30.716064 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5326e011-1459-413e-a139-b4d01e1354ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:30.724711 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5326e011-1459-413e-a139-b4d01e1354ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.158403 Aug 24 17:00:30.725292 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 516/1029] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:30 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:31.747035 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-439f26f3-c618-4426-9b86-c158a2464470 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:31.747725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-439f26f3-c618-4426-9b86-c158a2464470 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:31.753754 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-439f26f3-c618-4426-9b86-c158a2464470 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:31.754236 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-439f26f3-c618-4426-9b86-c158a2464470 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:31.754671 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-439f26f3-c618-4426-9b86-c158a2464470 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:31.755620 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-439f26f3-c618-4426-9b86-c158a2464470 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:31.756071 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-439f26f3-c618-4426-9b86-c158a2464470 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:31.756525 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-439f26f3-c618-4426-9b86-c158a2464470 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:31.883134 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-439f26f3-c618-4426-9b86-c158a2464470 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:31.891285 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-439f26f3-c618-4426-9b86-c158a2464470 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.148865 Aug 24 17:00:31.891837 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 514/1030] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:31 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:32.911623 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b061f4b3-a5b3-4731-8f74-88378ed8f639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:32.912237 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b061f4b3-a5b3-4731-8f74-88378ed8f639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:32.918693 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b061f4b3-a5b3-4731-8f74-88378ed8f639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:32.919171 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b061f4b3-a5b3-4731-8f74-88378ed8f639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:32.919600 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b061f4b3-a5b3-4731-8f74-88378ed8f639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:32.920280 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b061f4b3-a5b3-4731-8f74-88378ed8f639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:32.920753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b061f4b3-a5b3-4731-8f74-88378ed8f639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:32.921172 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b061f4b3-a5b3-4731-8f74-88378ed8f639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:33.050420 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b061f4b3-a5b3-4731-8f74-88378ed8f639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:33.057966 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b061f4b3-a5b3-4731-8f74-88378ed8f639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.150218 Aug 24 17:00:33.058557 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 517/1031] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:32 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:34.078606 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-05a53846-ef23-4672-b6a3-fdc71cf92271 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:34.079224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-05a53846-ef23-4672-b6a3-fdc71cf92271 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:34.086172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05a53846-ef23-4672-b6a3-fdc71cf92271 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:34.086663 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05a53846-ef23-4672-b6a3-fdc71cf92271 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:34.087107 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05a53846-ef23-4672-b6a3-fdc71cf92271 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:34.087812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05a53846-ef23-4672-b6a3-fdc71cf92271 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:34.088275 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05a53846-ef23-4672-b6a3-fdc71cf92271 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:34.088745 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05a53846-ef23-4672-b6a3-fdc71cf92271 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:34.219832 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-05a53846-ef23-4672-b6a3-fdc71cf92271 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:34.227617 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-05a53846-ef23-4672-b6a3-fdc71cf92271 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.152883 Aug 24 17:00:34.228428 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 515/1032] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:34 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:35.249634 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a559c11f-b587-4792-9612-ff99acc00fcf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:35.250192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a559c11f-b587-4792-9612-ff99acc00fcf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:35.256872 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a559c11f-b587-4792-9612-ff99acc00fcf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:35.257349 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a559c11f-b587-4792-9612-ff99acc00fcf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:35.257785 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a559c11f-b587-4792-9612-ff99acc00fcf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:35.258473 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a559c11f-b587-4792-9612-ff99acc00fcf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:35.258925 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a559c11f-b587-4792-9612-ff99acc00fcf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:35.259348 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a559c11f-b587-4792-9612-ff99acc00fcf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:35.389204 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a559c11f-b587-4792-9612-ff99acc00fcf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:35.396782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a559c11f-b587-4792-9612-ff99acc00fcf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.151731 Aug 24 17:00:35.397395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 518/1033] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:35 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:36.417897 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7f3054b9-000b-45a4-93cc-e4fd8e365b5a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:36.418545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7f3054b9-000b-45a4-93cc-e4fd8e365b5a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:36.421002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:36.421700 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=6 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:36.426447 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7f3054b9-000b-45a4-93cc-e4fd8e365b5a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:36.426926 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7f3054b9-000b-45a4-93cc-e4fd8e365b5a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:36.427374 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7f3054b9-000b-45a4-93cc-e4fd8e365b5a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:36.428072 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7f3054b9-000b-45a4-93cc-e4fd8e365b5a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:36.428564 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7f3054b9-000b-45a4-93cc-e4fd8e365b5a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:36.431489 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7f3054b9-000b-45a4-93cc-e4fd8e365b5a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:36.559727 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7f3054b9-000b-45a4-93cc-e4fd8e365b5a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:36.567493 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7f3054b9-000b-45a4-93cc-e4fd8e365b5a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.153458 Aug 24 17:00:36.568059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 516/1034] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:36 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:37.588637 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2790996d-6f1f-4add-91c0-276140d72d39 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:37.589251 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2790996d-6f1f-4add-91c0-276140d72d39 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:37.591742 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=6 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:37.596919 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2790996d-6f1f-4add-91c0-276140d72d39 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:37.597396 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2790996d-6f1f-4add-91c0-276140d72d39 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:37.597826 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2790996d-6f1f-4add-91c0-276140d72d39 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:37.598506 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2790996d-6f1f-4add-91c0-276140d72d39 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:37.598956 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2790996d-6f1f-4add-91c0-276140d72d39 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:37.599426 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2790996d-6f1f-4add-91c0-276140d72d39 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:37.726081 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2790996d-6f1f-4add-91c0-276140d72d39 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:37.733722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2790996d-6f1f-4add-91c0-276140d72d39 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.148939 Aug 24 17:00:37.734276 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 519/1035] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:37 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:38.754200 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-aef3a25f-e99e-441a-9d05-151e91419b98 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:38.754812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-aef3a25f-e99e-441a-9d05-151e91419b98 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:38.762090 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aef3a25f-e99e-441a-9d05-151e91419b98 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:38.762592 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aef3a25f-e99e-441a-9d05-151e91419b98 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:38.763010 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aef3a25f-e99e-441a-9d05-151e91419b98 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:38.763701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aef3a25f-e99e-441a-9d05-151e91419b98 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:38.764158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aef3a25f-e99e-441a-9d05-151e91419b98 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:38.764611 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-aef3a25f-e99e-441a-9d05-151e91419b98 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:38.895079 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-aef3a25f-e99e-441a-9d05-151e91419b98 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:38.902619 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-aef3a25f-e99e-441a-9d05-151e91419b98 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.152314 Aug 24 17:00:38.903181 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 517/1036] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:38 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:39.923663 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e17e7935-4498-4b1f-8f5d-8fc5c562efc5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:39.924271 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e17e7935-4498-4b1f-8f5d-8fc5c562efc5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:39.930812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e17e7935-4498-4b1f-8f5d-8fc5c562efc5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:39.931285 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e17e7935-4498-4b1f-8f5d-8fc5c562efc5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:39.931713 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e17e7935-4498-4b1f-8f5d-8fc5c562efc5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:39.932391 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e17e7935-4498-4b1f-8f5d-8fc5c562efc5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:39.932869 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e17e7935-4498-4b1f-8f5d-8fc5c562efc5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:39.933289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e17e7935-4498-4b1f-8f5d-8fc5c562efc5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:40.064167 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e17e7935-4498-4b1f-8f5d-8fc5c562efc5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:40.071712 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e17e7935-4498-4b1f-8f5d-8fc5c562efc5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.151941 Aug 24 17:00:40.072277 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 520/1037] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:39 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:41.092047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a6a98ebc-e7bc-43fb-9af7-62d50cf1e64b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:41.092694 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a6a98ebc-e7bc-43fb-9af7-62d50cf1e64b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:41.099147 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a6a98ebc-e7bc-43fb-9af7-62d50cf1e64b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:41.099648 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a6a98ebc-e7bc-43fb-9af7-62d50cf1e64b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:41.100094 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a6a98ebc-e7bc-43fb-9af7-62d50cf1e64b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:41.100829 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a6a98ebc-e7bc-43fb-9af7-62d50cf1e64b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:41.101295 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a6a98ebc-e7bc-43fb-9af7-62d50cf1e64b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:41.101744 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a6a98ebc-e7bc-43fb-9af7-62d50cf1e64b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:41.228488 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a6a98ebc-e7bc-43fb-9af7-62d50cf1e64b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:41.236683 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a6a98ebc-e7bc-43fb-9af7-62d50cf1e64b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.148427 Aug 24 17:00:41.237196 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 518/1038] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:41 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:42.257814 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-51d359f8-eb79-4011-b8df-360d95fed5ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:42.258431 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-51d359f8-eb79-4011-b8df-360d95fed5ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:42.265369 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51d359f8-eb79-4011-b8df-360d95fed5ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:42.265851 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51d359f8-eb79-4011-b8df-360d95fed5ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:42.266289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51d359f8-eb79-4011-b8df-360d95fed5ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:42.267006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51d359f8-eb79-4011-b8df-360d95fed5ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:42.267453 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51d359f8-eb79-4011-b8df-360d95fed5ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:42.267876 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51d359f8-eb79-4011-b8df-360d95fed5ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:42.395129 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-51d359f8-eb79-4011-b8df-360d95fed5ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:42.402814 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-51d359f8-eb79-4011-b8df-360d95fed5ec tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.149090 Aug 24 17:00:42.403375 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 521/1039] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:42 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:43.423763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-be3f55ff-1aa4-40f4-890d-fa162d302609 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:43.424388 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-be3f55ff-1aa4-40f4-890d-fa162d302609 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:43.430802 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be3f55ff-1aa4-40f4-890d-fa162d302609 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:43.431289 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be3f55ff-1aa4-40f4-890d-fa162d302609 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:43.431724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be3f55ff-1aa4-40f4-890d-fa162d302609 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:43.432426 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be3f55ff-1aa4-40f4-890d-fa162d302609 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:43.432893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be3f55ff-1aa4-40f4-890d-fa162d302609 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:43.433320 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be3f55ff-1aa4-40f4-890d-fa162d302609 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:43.562744 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-be3f55ff-1aa4-40f4-890d-fa162d302609 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:43.570353 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-be3f55ff-1aa4-40f4-890d-fa162d302609 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.150477 Aug 24 17:00:43.570921 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 519/1040] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:43 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:44.591864 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0753a988-1cb5-496f-b5f5-e5633d157d31 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:44.592527 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0753a988-1cb5-496f-b5f5-e5633d157d31 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:44.598927 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0753a988-1cb5-496f-b5f5-e5633d157d31 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:44.601781 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0753a988-1cb5-496f-b5f5-e5633d157d31 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:44.603726 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0753a988-1cb5-496f-b5f5-e5633d157d31 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:44.604436 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0753a988-1cb5-496f-b5f5-e5633d157d31 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:44.604894 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0753a988-1cb5-496f-b5f5-e5633d157d31 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:44.605312 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0753a988-1cb5-496f-b5f5-e5633d157d31 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:44.733684 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0753a988-1cb5-496f-b5f5-e5633d157d31 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:44.741233 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0753a988-1cb5-496f-b5f5-e5633d157d31 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.153896 Aug 24 17:00:44.741788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 522/1041] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:44 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:45.762569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-511a77d5-6700-44a3-982a-9345a5152b30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:45.763190 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-511a77d5-6700-44a3-982a-9345a5152b30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:45.769656 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-511a77d5-6700-44a3-982a-9345a5152b30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:45.770176 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-511a77d5-6700-44a3-982a-9345a5152b30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:45.770616 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-511a77d5-6700-44a3-982a-9345a5152b30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:45.771303 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-511a77d5-6700-44a3-982a-9345a5152b30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:45.771764 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-511a77d5-6700-44a3-982a-9345a5152b30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:45.772189 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-511a77d5-6700-44a3-982a-9345a5152b30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:45.907209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-511a77d5-6700-44a3-982a-9345a5152b30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:45.914818 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-511a77d5-6700-44a3-982a-9345a5152b30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.156630 Aug 24 17:00:45.915384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 520/1042] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:45 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:46.936127 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7608347f-1335-4cf6-a71d-3119220f1a85 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:46.936775 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7608347f-1335-4cf6-a71d-3119220f1a85 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:46.943399 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7608347f-1335-4cf6-a71d-3119220f1a85 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:46.943859 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7608347f-1335-4cf6-a71d-3119220f1a85 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:46.946371 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7608347f-1335-4cf6-a71d-3119220f1a85 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:46.946371 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7608347f-1335-4cf6-a71d-3119220f1a85 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:46.946371 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7608347f-1335-4cf6-a71d-3119220f1a85 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:46.946371 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7608347f-1335-4cf6-a71d-3119220f1a85 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:47.315724 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7608347f-1335-4cf6-a71d-3119220f1a85 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:47.323511 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7608347f-1335-4cf6-a71d-3119220f1a85 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.392160 Aug 24 17:00:47.325391 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 523/1043] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:46 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:48.346058 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2f98c335-f369-432d-92e7-7db3346bcd7e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:48.346701 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2f98c335-f369-432d-92e7-7db3346bcd7e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:48.353458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2f98c335-f369-432d-92e7-7db3346bcd7e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:48.353950 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2f98c335-f369-432d-92e7-7db3346bcd7e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:48.354388 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2f98c335-f369-432d-92e7-7db3346bcd7e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:48.355088 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2f98c335-f369-432d-92e7-7db3346bcd7e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:48.355559 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2f98c335-f369-432d-92e7-7db3346bcd7e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:48.356567 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2f98c335-f369-432d-92e7-7db3346bcd7e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:48.481677 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2f98c335-f369-432d-92e7-7db3346bcd7e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:48.489395 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2f98c335-f369-432d-92e7-7db3346bcd7e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.147163 Aug 24 17:00:48.489957 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 521/1044] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:48 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:49.510145 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fad3cfde-bb0d-45c3-b239-9d77b8432f5c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:49.510764 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fad3cfde-bb0d-45c3-b239-9d77b8432f5c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:49.517230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fad3cfde-bb0d-45c3-b239-9d77b8432f5c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:49.517717 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fad3cfde-bb0d-45c3-b239-9d77b8432f5c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:49.518159 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fad3cfde-bb0d-45c3-b239-9d77b8432f5c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:49.518847 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fad3cfde-bb0d-45c3-b239-9d77b8432f5c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:49.519306 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fad3cfde-bb0d-45c3-b239-9d77b8432f5c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:49.519730 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fad3cfde-bb0d-45c3-b239-9d77b8432f5c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:49.663100 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fad3cfde-bb0d-45c3-b239-9d77b8432f5c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:49.671359 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fad3cfde-bb0d-45c3-b239-9d77b8432f5c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.165025 Aug 24 17:00:49.671924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 524/1045] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:49 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:50.692603 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f4113a33-16d6-4ab4-93bf-98b0c8dcc639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:50.693146 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f4113a33-16d6-4ab4-93bf-98b0c8dcc639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:50.699185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f4113a33-16d6-4ab4-93bf-98b0c8dcc639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:50.700152 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f4113a33-16d6-4ab4-93bf-98b0c8dcc639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:50.700615 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f4113a33-16d6-4ab4-93bf-98b0c8dcc639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:50.701298 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f4113a33-16d6-4ab4-93bf-98b0c8dcc639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:50.701769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f4113a33-16d6-4ab4-93bf-98b0c8dcc639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:50.702191 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f4113a33-16d6-4ab4-93bf-98b0c8dcc639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:50.826771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f4113a33-16d6-4ab4-93bf-98b0c8dcc639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:50.834398 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f4113a33-16d6-4ab4-93bf-98b0c8dcc639 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.145760 Aug 24 17:00:50.834962 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 522/1046] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:50 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:51.855066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e1ce48a8-db70-440a-9921-5b07e7345c27 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:51.855685 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e1ce48a8-db70-440a-9921-5b07e7345c27 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:51.862717 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1ce48a8-db70-440a-9921-5b07e7345c27 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:51.863204 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1ce48a8-db70-440a-9921-5b07e7345c27 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:51.863645 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1ce48a8-db70-440a-9921-5b07e7345c27 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:51.864341 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1ce48a8-db70-440a-9921-5b07e7345c27 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:51.864827 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1ce48a8-db70-440a-9921-5b07e7345c27 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:51.865255 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1ce48a8-db70-440a-9921-5b07e7345c27 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:51.995584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e1ce48a8-db70-440a-9921-5b07e7345c27 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:52.003713 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e1ce48a8-db70-440a-9921-5b07e7345c27 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.152487 Aug 24 17:00:52.004268 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 525/1047] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:51 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:53.025519 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6929acd0-689d-432b-b177-202985ee1d58 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:53.026171 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6929acd0-689d-432b-b177-202985ee1d58 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:53.033712 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6929acd0-689d-432b-b177-202985ee1d58 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:53.037057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6929acd0-689d-432b-b177-202985ee1d58 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:53.037057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6929acd0-689d-432b-b177-202985ee1d58 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:53.037057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6929acd0-689d-432b-b177-202985ee1d58 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:53.037057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6929acd0-689d-432b-b177-202985ee1d58 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:53.037464 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6929acd0-689d-432b-b177-202985ee1d58 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:53.177743 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6929acd0-689d-432b-b177-202985ee1d58 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:53.186687 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-65540c85-e95b-4b90-8db2-a14541a2ddf9 req-63a228fb-9502-41d7-a186-1aae4ae27dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f799b07-9fb4-4890-841d-d4621c0a6980", "name": "network-vif-plugged", "status": "completed", "tag": "e716512b-6e25-445c-a0e9-754d2f1c4c8c"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:00:53.187241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6929acd0-689d-432b-b177-202985ee1d58 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.163961 Aug 24 17:00:53.187241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 523/1048] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:53 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:53.194669 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-65540c85-e95b-4b90-8db2-a14541a2ddf9 req-63a228fb-9502-41d7-a186-1aae4ae27dfb service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:53.195360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-65540c85-e95b-4b90-8db2-a14541a2ddf9 req-63a228fb-9502-41d7-a186-1aae4ae27dfb service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:53.195968 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-65540c85-e95b-4b90-8db2-a14541a2ddf9 req-63a228fb-9502-41d7-a186-1aae4ae27dfb service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:53.207470 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-65540c85-e95b-4b90-8db2-a14541a2ddf9 req-63a228fb-9502-41d7-a186-1aae4ae27dfb service nova] Creating event network-vif-plugged:e716512b-6e25-445c-a0e9-754d2f1c4c8c for instance 4f799b07-9fb4-4890-841d-d4621c0a6980 on hv-cinder-85220 Aug 24 17:00:53.213038 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-65540c85-e95b-4b90-8db2-a14541a2ddf9 req-63a228fb-9502-41d7-a186-1aae4ae27dfb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156101 Aug 24 17:00:53.213684 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 526/1049] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:00:53.504242 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-88f278c4-ddb9-417e-b986-b9bbdd6d6c06 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:53.505006 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-88f278c4-ddb9-417e-b986-b9bbdd6d6c06 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:53.511970 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88f278c4-ddb9-417e-b986-b9bbdd6d6c06 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:53.513080 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88f278c4-ddb9-417e-b986-b9bbdd6d6c06 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:53.513809 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88f278c4-ddb9-417e-b986-b9bbdd6d6c06 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:53.514927 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88f278c4-ddb9-417e-b986-b9bbdd6d6c06 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:53.515586 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88f278c4-ddb9-417e-b986-b9bbdd6d6c06 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:53.516028 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-88f278c4-ddb9-417e-b986-b9bbdd6d6c06 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:53.608611 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-88f278c4-ddb9-417e-b986-b9bbdd6d6c06 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lazy-loading 'services' on Instance uuid 8e266f10-7f28-4301-bccf-43e4e4c0a50e {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:00:53.793793 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-88f278c4-ddb9-417e-b986-b9bbdd6d6c06 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e/os-volume_attachments/b21e55fc-a334-4997-8dff-5df9a6e4fa80" status: 202 len: 0 microversion: 2.1 time: 0.293365 Aug 24 17:00:53.794386 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 524/1050] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Aug 24 17:00:53 2022] DELETE /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e/os-volume_attachments/b21e55fc-a334-4997-8dff-5df9a6e4fa80 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:00:54.206998 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d4518ec7-334f-4adc-825b-c8993d4aa664 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:54.207628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d4518ec7-334f-4adc-825b-c8993d4aa664 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:54.213828 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4518ec7-334f-4adc-825b-c8993d4aa664 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:54.214313 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4518ec7-334f-4adc-825b-c8993d4aa664 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:54.218484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4518ec7-334f-4adc-825b-c8993d4aa664 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:54.218484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4518ec7-334f-4adc-825b-c8993d4aa664 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:54.218484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4518ec7-334f-4adc-825b-c8993d4aa664 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:54.218484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4518ec7-334f-4adc-825b-c8993d4aa664 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:54.346215 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d4518ec7-334f-4adc-825b-c8993d4aa664 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:54.354079 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d4518ec7-334f-4adc-825b-c8993d4aa664 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.151847 Aug 24 17:00:54.354640 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 527/1051] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:54 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:55.376376 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0d0e1e93-6750-49c1-9710-7107be1519e1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:55.377122 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0d0e1e93-6750-49c1-9710-7107be1519e1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:55.384113 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d0e1e93-6750-49c1-9710-7107be1519e1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:55.384698 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d0e1e93-6750-49c1-9710-7107be1519e1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:55.385138 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d0e1e93-6750-49c1-9710-7107be1519e1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:55.385856 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d0e1e93-6750-49c1-9710-7107be1519e1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:55.386318 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d0e1e93-6750-49c1-9710-7107be1519e1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:55.386745 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d0e1e93-6750-49c1-9710-7107be1519e1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:55.519979 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0d0e1e93-6750-49c1-9710-7107be1519e1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:55.528490 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0d0e1e93-6750-49c1-9710-7107be1519e1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1361 microversion: 2.1 time: 0.157028 Aug 24 17:00:55.529060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 525/1052] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:55 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:55.970522 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-703c4c9d-5daa-46b9-88a7-b639fdbc5281 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:55.971096 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-703c4c9d-5daa-46b9-88a7-b639fdbc5281 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:55.977475 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-703c4c9d-5daa-46b9-88a7-b639fdbc5281 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:55.977955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-703c4c9d-5daa-46b9-88a7-b639fdbc5281 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:55.978388 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-703c4c9d-5daa-46b9-88a7-b639fdbc5281 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:55.979082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-703c4c9d-5daa-46b9-88a7-b639fdbc5281 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:55.979536 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-703c4c9d-5daa-46b9-88a7-b639fdbc5281 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:55.979957 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-703c4c9d-5daa-46b9-88a7-b639fdbc5281 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:56.005055 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-703c4c9d-5daa-46b9-88a7-b639fdbc5281 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:00:56.337568 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-703c4c9d-5daa-46b9-88a7-b639fdbc5281 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 204 len: 0 microversion: 2.1 time: 0.370523 Aug 24 17:00:56.338157 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 528/1053] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 17:00:55 2022] DELETE /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:00:56.346889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f47364c3-666b-4ce2-a289-ba26cf1c721f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:56.347554 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f47364c3-666b-4ce2-a289-ba26cf1c721f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:56.349534 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:56.354230 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f47364c3-666b-4ce2-a289-ba26cf1c721f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:56.354716 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f47364c3-666b-4ce2-a289-ba26cf1c721f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:56.355154 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f47364c3-666b-4ce2-a289-ba26cf1c721f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:56.355855 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f47364c3-666b-4ce2-a289-ba26cf1c721f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:56.356310 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f47364c3-666b-4ce2-a289-ba26cf1c721f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:56.356762 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f47364c3-666b-4ce2-a289-ba26cf1c721f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:56.359335 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:56.497954 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f47364c3-666b-4ce2-a289-ba26cf1c721f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:56.505727 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f47364c3-666b-4ce2-a289-ba26cf1c721f tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1513 microversion: 2.1 time: 0.163029 Aug 24 17:00:56.506407 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 526/1054] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:56 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:56.549871 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-839a63a0-38ef-4ff7-b5ec-df9b857683b0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:56.550580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-839a63a0-38ef-4ff7-b5ec-df9b857683b0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:56.556529 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-839a63a0-38ef-4ff7-b5ec-df9b857683b0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:56.557016 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-839a63a0-38ef-4ff7-b5ec-df9b857683b0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:56.557455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-839a63a0-38ef-4ff7-b5ec-df9b857683b0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:56.558175 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-839a63a0-38ef-4ff7-b5ec-df9b857683b0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:56.559142 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-839a63a0-38ef-4ff7-b5ec-df9b857683b0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:56.559577 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-839a63a0-38ef-4ff7-b5ec-df9b857683b0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:56.563620 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:56.692636 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-839a63a0-38ef-4ff7-b5ec-df9b857683b0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:56.700437 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-839a63a0-38ef-4ff7-b5ec-df9b857683b0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1545 microversion: 2.1 time: 0.154878 Aug 24 17:00:56.700986 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 529/1055] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:56 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1545 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:56.721225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-349c3cae-381f-45c6-afd3-7560b5c616b3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:56.721717 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-349c3cae-381f-45c6-afd3-7560b5c616b3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:56.727930 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-349c3cae-381f-45c6-afd3-7560b5c616b3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:56.728426 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-349c3cae-381f-45c6-afd3-7560b5c616b3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:56.728909 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-349c3cae-381f-45c6-afd3-7560b5c616b3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:56.729597 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-349c3cae-381f-45c6-afd3-7560b5c616b3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:56.730057 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-349c3cae-381f-45c6-afd3-7560b5c616b3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:56.730483 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-349c3cae-381f-45c6-afd3-7560b5c616b3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:56.807026 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-349c3cae-381f-45c6-afd3-7560b5c616b3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090452 Aug 24 17:00:56.807621 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 527/1056] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Aug 24 17:00:56 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:00:57.527280 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b0206ab6-bc98-4ad7-ace0-e9fac5d7aef6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:57.527907 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b0206ab6-bc98-4ad7-ace0-e9fac5d7aef6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:57.533818 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b0206ab6-bc98-4ad7-ace0-e9fac5d7aef6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:57.534296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b0206ab6-bc98-4ad7-ace0-e9fac5d7aef6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:57.534768 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b0206ab6-bc98-4ad7-ace0-e9fac5d7aef6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:57.535454 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b0206ab6-bc98-4ad7-ace0-e9fac5d7aef6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:57.535908 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b0206ab6-bc98-4ad7-ace0-e9fac5d7aef6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:57.536354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b0206ab6-bc98-4ad7-ace0-e9fac5d7aef6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:57.698404 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b0206ab6-bc98-4ad7-ace0-e9fac5d7aef6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:57.707610 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b0206ab6-bc98-4ad7-ace0-e9fac5d7aef6 tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1513 microversion: 2.1 time: 0.184281 Aug 24 17:00:57.708173 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 530/1057] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:57 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:57.899838 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-f5238fe1-00dd-45a5-b0cc-ae7d5f01e514 req-93bea536-176c-4393-8136-eb2ace67bbc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f799b07-9fb4-4890-841d-d4621c0a6980", "tag": "e716512b-6e25-445c-a0e9-754d2f1c4c8c"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:00:57.909999 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f5238fe1-00dd-45a5-b0cc-ae7d5f01e514 req-93bea536-176c-4393-8136-eb2ace67bbc3 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:57.910490 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f5238fe1-00dd-45a5-b0cc-ae7d5f01e514 req-93bea536-176c-4393-8136-eb2ace67bbc3 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:57.910932 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-f5238fe1-00dd-45a5-b0cc-ae7d5f01e514 req-93bea536-176c-4393-8136-eb2ace67bbc3 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:57.922318 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-f5238fe1-00dd-45a5-b0cc-ae7d5f01e514 req-93bea536-176c-4393-8136-eb2ace67bbc3 service nova] Creating event network-changed:e716512b-6e25-445c-a0e9-754d2f1c4c8c for instance 4f799b07-9fb4-4890-841d-d4621c0a6980 on hv-cinder-85220 Aug 24 17:00:57.927571 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-f5238fe1-00dd-45a5-b0cc-ae7d5f01e514 req-93bea536-176c-4393-8136-eb2ace67bbc3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095547 Aug 24 17:00:57.931137 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 528/1058] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:00:58.734149 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f853628f-4471-4c00-9072-eaa9895ab0df tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:58.735137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f853628f-4471-4c00-9072-eaa9895ab0df tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:58.742022 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f853628f-4471-4c00-9072-eaa9895ab0df tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:58.742498 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f853628f-4471-4c00-9072-eaa9895ab0df tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:58.742972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f853628f-4471-4c00-9072-eaa9895ab0df tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:58.743666 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f853628f-4471-4c00-9072-eaa9895ab0df tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:58.744117 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f853628f-4471-4c00-9072-eaa9895ab0df tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:58.744592 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f853628f-4471-4c00-9072-eaa9895ab0df tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:58.888492 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f853628f-4471-4c00-9072-eaa9895ab0df tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:00:58.896525 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f853628f-4471-4c00-9072-eaa9895ab0df tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1513 microversion: 2.1 time: 0.167058 Aug 24 17:00:58.897090 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 531/1059] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:58 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:00:59.301803 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-d8fe1cba-4ede-449a-8195-e4f7ab856d26 req-8c93eeb7-ded8-4aac-a192-b7d14627740f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e266f10-7f28-4301-bccf-43e4e4c0a50e", "name": "network-vif-deleted", "tag": "a9baabb8-dd3f-40cd-bbe5-bf54f463ff6c"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:00:59.312511 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-d8fe1cba-4ede-449a-8195-e4f7ab856d26 req-8c93eeb7-ded8-4aac-a192-b7d14627740f service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:59.312999 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-d8fe1cba-4ede-449a-8195-e4f7ab856d26 req-8c93eeb7-ded8-4aac-a192-b7d14627740f service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:59.313437 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-d8fe1cba-4ede-449a-8195-e4f7ab856d26 req-8c93eeb7-ded8-4aac-a192-b7d14627740f service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:59.324195 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-d8fe1cba-4ede-449a-8195-e4f7ab856d26 req-8c93eeb7-ded8-4aac-a192-b7d14627740f service nova] Creating event network-vif-deleted:a9baabb8-dd3f-40cd-bbe5-bf54f463ff6c for instance 8e266f10-7f28-4301-bccf-43e4e4c0a50e on hv-cinder-85220 Aug 24 17:00:59.329637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-d8fe1cba-4ede-449a-8195-e4f7ab856d26 req-8c93eeb7-ded8-4aac-a192-b7d14627740f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033068 Aug 24 17:00:59.330229 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 529/1060] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:00:59.917720 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:00:59.918331 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:00:59.925316 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:59.925788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:59.926212 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:59.926950 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:59.927399 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:59.927813 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:59.961060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:00:59.961532 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:00:59.961957 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:00:59.962414 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lazy-loading 'fault' on Instance uuid 8e266f10-7f28-4301-bccf-43e4e4c0a50e {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:01:00.006733 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd715cc7828f847529f795f356a8ac16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1088b1d454684ca5be800a99d4e26304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:00.014580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2abcc426-d597-4d5a-b0f2-579c199532ea tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 200 len: 1309 microversion: 2.1 time: 0.100685 Aug 24 17:01:00.015155 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 532/1061] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:00:59 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:01.037515 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-83f786cb-2576-4cbf-b9b5-9eb6516de06a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:01.038436 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-83f786cb-2576-4cbf-b9b5-9eb6516de06a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] [instance: 8e266f10-7f28-4301-bccf-43e4e4c0a50e] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:01.045399 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83f786cb-2576-4cbf-b9b5-9eb6516de06a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:01.045891 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83f786cb-2576-4cbf-b9b5-9eb6516de06a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:01.046331 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83f786cb-2576-4cbf-b9b5-9eb6516de06a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:01.047029 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83f786cb-2576-4cbf-b9b5-9eb6516de06a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:01.047493 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83f786cb-2576-4cbf-b9b5-9eb6516de06a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:01.047924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-83f786cb-2576-4cbf-b9b5-9eb6516de06a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:01.062144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-83f786cb-2576-4cbf-b9b5-9eb6516de06a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] HTTP exception thrown: Instance 8e266f10-7f28-4301-bccf-43e4e4c0a50e could not be found. Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-83f786cb-2576-4cbf-b9b5-9eb6516de06a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Request method failure captured: Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e HTTP/1.1 Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBliS5W3B5i33JV94KA3klwQ-lBNksO9E-Ag4Hki7r_gRf197VuTtyQllRuahPcJrwC3KzQt0X6N9ZBm9RJjRrqyxygu9Rxejsn1eAaIvtQAp4powY7-EWo45YG_Im2oayolT-KQzuag3tsaL7yW1XnKRD6B0sHl8P9jcjtTvl03Xos0 Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 1088b1d454684ca5be800a99d4e26304 Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1744929539 Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 17:01:01.066419 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 17:01:01.068158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1088b1d454684ca5be800a99d4e26304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1088b1d454684ca5be800a99d4e26304"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1088b1d454684ca5be800a99d4e26304"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1088b1d454684ca5be800a99d4e26304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:01:01.068158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-VolumesSnapshotTestJSON-1744929539 Aug 24 17:01:01.068158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 1088b1d454684ca5be800a99d4e26304 Aug 24 17:01:01.068158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1744929539 Aug 24 17:01:01.068158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-VolumesSnapshotTestJSON-1744929539-project Aug 24 17:01:01.068158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 17:01:01.068158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 17:01:01.068158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: d715cc7828f847529f795f356a8ac16b Aug 24 17:01:01.068158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-VolumesSnapshotTestJSON-1744929539-project Aug 24 17:01:01.068158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 17:01:01.068158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 8e266f10-7f28-4301-bccf-43e4e4c0a50e could not be found. Aug 24 17:01:01.068158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '8e266f10-7f28-4301-bccf-43e4e4c0a50e'} Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e266f10-7f28-4301-bccf-43e4e4c0a50e could not be found. Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:01:01.069127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e266f10-7f28-4301-bccf-43e4e4c0a50e could not be found. Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e266f10-7f28-4301-bccf-43e4e4c0a50e could not be found. Aug 24 17:01:01.070782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:01:01.072260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-83f786cb-2576-4cbf-b9b5-9eb6516de06a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] Returning 404 to user: Instance 8e266f10-7f28-4301-bccf-43e4e4c0a50e could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:01:01.072260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-83f786cb-2576-4cbf-b9b5-9eb6516de06a tempest-VolumesSnapshotTestJSON-1744929539 tempest-VolumesSnapshotTestJSON-1744929539-project] 10.222.0.70 "GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e" status: 404 len: 111 microversion: 2.1 time: 0.032528 Aug 24 17:01:01.072260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 530/1062] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:01 2022] GET /compute/v2.1/servers/8e266f10-7f28-4301-bccf-43e4e4c0a50e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:01:23.660289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8b093219-8b0c-4554-a852-e7532149caa3 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Action: 'create', calling method: .version_select at 0x7fa1992b2e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1255832466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHm6ttTvigHHcacOwc2BKxtcwzHCQyUuwXStQsOzQjYmRRrp31964QCJm1oQ1MvFb7Sm1rMMn+/Cq+5fBtOuI607EfC85HTmuojUUz6B9//PrrV3trHEndX7j73fjiu+Q=="}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:01:23.666259 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:23.666896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=25 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:23.677241 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-8b093219-8b0c-4554-a852-e7532149caa3 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Getting quotas for project 6d4ca39653d24886b79e5e7175e7b4cc. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:01:23.681002 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-8b093219-8b0c-4554-a852-e7532149caa3 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Getting quotas for user 4bdcfac8e4bf4b589d3958be4fd032f2 and project 6d4ca39653d24886b79e5e7175e7b4cc. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:01:23.812560 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8b093219-8b0c-4554-a852-e7532149caa3 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.155426 Aug 24 17:01:23.812848 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 533/1063] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Aug 24 17:01:23 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:01:23.864839 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-962095235", "imageRef": "dec0ceb8-a1aa-405c-8165-2dc1df13cb07", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1255832466", "networks": [{"uuid": "11e6a377-ec1f-45b5-ab15-5e8238fdfd30"}]}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:01:23.873862 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=9 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:23.874550 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=15 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:23.918625 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.network.neutron [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] validate_networks() for [('11e6a377-ec1f-45b5-ab15-5e8238fdfd30', None, None, None, None, None)] {{(pid=127715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:01:24.288695 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Flavor limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:01:24.289131 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Image limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:01:24.289671 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Flavor pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:01:24.290113 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Image pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:01:24.290530 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:01:24.299933 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:24.300446 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:24.300888 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:24.301675 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:24.302140 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:24.302564 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:24.320252 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Getting quotas for project 6d4ca39653d24886b79e5e7175e7b4cc. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:01:24.324255 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Getting quotas for user 4bdcfac8e4bf4b589d3958be4fd032f2 and project 6d4ca39653d24886b79e5e7175e7b4cc. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:01:24.335468 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Going to run 1 instances... {{(pid=127715) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:01:24.337785 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dec0ceb8-a1aa-405c-8165-2dc1df13cb07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:01:24.515777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-55427a9a-a6c7-445c-bd34-ade6f0b0bc59 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654966 Aug 24 17:01:24.516358 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 531/1064] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 17:01:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:01:24.528837 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce4d8e01-c178-49c4-b8d9-720cf5d5f1f8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:24.529461 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ce4d8e01-c178-49c4-b8d9-720cf5d5f1f8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:24.590903 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ce4d8e01-c178-49c4-b8d9-720cf5d5f1f8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:24.597718 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ce4d8e01-c178-49c4-b8d9-720cf5d5f1f8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1258 microversion: 2.1 time: 0.074402 Aug 24 17:01:24.598278 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 534/1065] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:24 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:25.619015 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-14851b78-22d0-4017-940a-0114e7e289d3 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:25.619651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-14851b78-22d0-4017-940a-0114e7e289d3 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:25.672185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-14851b78-22d0-4017-940a-0114e7e289d3 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:25.679814 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-14851b78-22d0-4017-940a-0114e7e289d3 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1258 microversion: 2.1 time: 0.064663 Aug 24 17:01:25.680615 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 532/1066] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:25 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:26.700926 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c99702cf-e1f3-4cdf-a2b5-ea07d2b3f3a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:26.701547 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c99702cf-e1f3-4cdf-a2b5-ea07d2b3f3a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:26.707692 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c99702cf-e1f3-4cdf-a2b5-ea07d2b3f3a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:26.708184 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c99702cf-e1f3-4cdf-a2b5-ea07d2b3f3a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:26.708702 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c99702cf-e1f3-4cdf-a2b5-ea07d2b3f3a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:26.709429 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c99702cf-e1f3-4cdf-a2b5-ea07d2b3f3a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:26.709887 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c99702cf-e1f3-4cdf-a2b5-ea07d2b3f3a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:26.710314 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c99702cf-e1f3-4cdf-a2b5-ea07d2b3f3a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:26.776576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c99702cf-e1f3-4cdf-a2b5-ea07d2b3f3a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:26.784538 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c99702cf-e1f3-4cdf-a2b5-ea07d2b3f3a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1310 microversion: 2.1 time: 0.088112 Aug 24 17:01:26.785349 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 535/1067] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:26 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:27.810579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1a026679-1c0d-41dd-8244-d104e7115902 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:27.812061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1a026679-1c0d-41dd-8244-d104e7115902 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:27.828976 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a026679-1c0d-41dd-8244-d104e7115902 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:27.829440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a026679-1c0d-41dd-8244-d104e7115902 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:27.829889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a026679-1c0d-41dd-8244-d104e7115902 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:27.830651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a026679-1c0d-41dd-8244-d104e7115902 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:27.833802 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a026679-1c0d-41dd-8244-d104e7115902 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:27.834249 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1a026679-1c0d-41dd-8244-d104e7115902 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:28.020564 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1a026679-1c0d-41dd-8244-d104e7115902 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:28.031791 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1a026679-1c0d-41dd-8244-d104e7115902 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.229451 Aug 24 17:01:28.033172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 533/1068] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:27 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:28.817391 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-c21ff50b-2d4f-4c2c-aa04-4897ba8ca20f req-6ca4a43b-e373-4810-9a05-b161e877903e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9129ed01-364e-4c0b-ad15-040bdaaaec13", "tag": "36e5522b-8ad1-4469-99a6-9ee02971e5ff"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:01:28.827121 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-c21ff50b-2d4f-4c2c-aa04-4897ba8ca20f req-6ca4a43b-e373-4810-9a05-b161e877903e service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:28.827597 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-c21ff50b-2d4f-4c2c-aa04-4897ba8ca20f req-6ca4a43b-e373-4810-9a05-b161e877903e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:28.828018 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-c21ff50b-2d4f-4c2c-aa04-4897ba8ca20f req-6ca4a43b-e373-4810-9a05-b161e877903e service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:28.840484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-c21ff50b-2d4f-4c2c-aa04-4897ba8ca20f req-6ca4a43b-e373-4810-9a05-b161e877903e service nova] Creating event network-changed:36e5522b-8ad1-4469-99a6-9ee02971e5ff for instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 on hv-cinder-85220 Aug 24 17:01:28.846151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-c21ff50b-2d4f-4c2c-aa04-4897ba8ca20f req-6ca4a43b-e373-4810-9a05-b161e877903e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032404 Aug 24 17:01:28.847290 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 536/1069] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:01:29.054581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f8e26610-77fb-407c-9406-443ee5d0d1e9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:29.055209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f8e26610-77fb-407c-9406-443ee5d0d1e9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:29.061817 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8e26610-77fb-407c-9406-443ee5d0d1e9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:29.062438 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8e26610-77fb-407c-9406-443ee5d0d1e9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:29.062936 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8e26610-77fb-407c-9406-443ee5d0d1e9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:29.063702 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8e26610-77fb-407c-9406-443ee5d0d1e9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:29.064231 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8e26610-77fb-407c-9406-443ee5d0d1e9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:29.064757 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8e26610-77fb-407c-9406-443ee5d0d1e9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:29.201863 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f8e26610-77fb-407c-9406-443ee5d0d1e9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:29.210302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f8e26610-77fb-407c-9406-443ee5d0d1e9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.160024 Aug 24 17:01:29.222090 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 534/1070] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:29 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:30.233726 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d455e44c-eb11-4a8f-8e51-85a05a368949 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:30.234361 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d455e44c-eb11-4a8f-8e51-85a05a368949 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:30.241137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d455e44c-eb11-4a8f-8e51-85a05a368949 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:30.241624 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d455e44c-eb11-4a8f-8e51-85a05a368949 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:30.242060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d455e44c-eb11-4a8f-8e51-85a05a368949 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:30.242757 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d455e44c-eb11-4a8f-8e51-85a05a368949 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:30.243213 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d455e44c-eb11-4a8f-8e51-85a05a368949 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:30.243637 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d455e44c-eb11-4a8f-8e51-85a05a368949 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:30.379999 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d455e44c-eb11-4a8f-8e51-85a05a368949 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:30.388575 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d455e44c-eb11-4a8f-8e51-85a05a368949 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.159431 Aug 24 17:01:30.389136 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 537/1071] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:30 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:31.409510 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7267435c-9ebd-467c-a5dc-a9879a82d47d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:31.410858 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7267435c-9ebd-467c-a5dc-a9879a82d47d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:31.419137 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7267435c-9ebd-467c-a5dc-a9879a82d47d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:31.419954 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7267435c-9ebd-467c-a5dc-a9879a82d47d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:31.420635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7267435c-9ebd-467c-a5dc-a9879a82d47d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:31.421531 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7267435c-9ebd-467c-a5dc-a9879a82d47d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:31.421983 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7267435c-9ebd-467c-a5dc-a9879a82d47d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:31.422406 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7267435c-9ebd-467c-a5dc-a9879a82d47d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:31.565229 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7267435c-9ebd-467c-a5dc-a9879a82d47d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:31.580202 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7267435c-9ebd-467c-a5dc-a9879a82d47d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.174935 Aug 24 17:01:31.590477 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 535/1072] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:31 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:32.603289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b53a31f9-156d-4a09-8cd4-dda56cdaa4d7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:32.603963 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b53a31f9-156d-4a09-8cd4-dda56cdaa4d7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:32.610956 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b53a31f9-156d-4a09-8cd4-dda56cdaa4d7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:32.611512 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b53a31f9-156d-4a09-8cd4-dda56cdaa4d7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:32.611954 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b53a31f9-156d-4a09-8cd4-dda56cdaa4d7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:32.612908 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b53a31f9-156d-4a09-8cd4-dda56cdaa4d7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:32.618652 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b53a31f9-156d-4a09-8cd4-dda56cdaa4d7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:32.618652 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b53a31f9-156d-4a09-8cd4-dda56cdaa4d7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:32.759519 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b53a31f9-156d-4a09-8cd4-dda56cdaa4d7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:32.767954 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b53a31f9-156d-4a09-8cd4-dda56cdaa4d7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.168437 Aug 24 17:01:32.769069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 538/1073] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:32 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:33.797532 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-13a7132b-2add-4568-93dd-640168460703 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:33.798112 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-13a7132b-2add-4568-93dd-640168460703 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:33.804755 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-13a7132b-2add-4568-93dd-640168460703 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:33.805241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-13a7132b-2add-4568-93dd-640168460703 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:33.805672 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-13a7132b-2add-4568-93dd-640168460703 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:33.806371 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-13a7132b-2add-4568-93dd-640168460703 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:33.806819 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-13a7132b-2add-4568-93dd-640168460703 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:33.807238 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-13a7132b-2add-4568-93dd-640168460703 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:33.955248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-13a7132b-2add-4568-93dd-640168460703 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:33.963354 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-13a7132b-2add-4568-93dd-640168460703 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.171205 Aug 24 17:01:33.963950 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 536/1074] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:33 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:34.986196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e895daa6-bb1c-49de-a3c6-ab6a382f22e2 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:34.986968 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e895daa6-bb1c-49de-a3c6-ab6a382f22e2 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:34.989645 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=6 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:34.994920 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e895daa6-bb1c-49de-a3c6-ab6a382f22e2 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:34.995972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e895daa6-bb1c-49de-a3c6-ab6a382f22e2 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:34.996521 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e895daa6-bb1c-49de-a3c6-ab6a382f22e2 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:34.997232 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e895daa6-bb1c-49de-a3c6-ab6a382f22e2 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:34.997691 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e895daa6-bb1c-49de-a3c6-ab6a382f22e2 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:34.998133 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e895daa6-bb1c-49de-a3c6-ab6a382f22e2 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:35.133428 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e895daa6-bb1c-49de-a3c6-ab6a382f22e2 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:35.141820 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e895daa6-bb1c-49de-a3c6-ab6a382f22e2 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.159770 Aug 24 17:01:35.142381 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 539/1075] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:34 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:36.162950 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ec4603fc-9bf5-4418-86b8-4def9a5b1100 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:36.163559 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ec4603fc-9bf5-4418-86b8-4def9a5b1100 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:36.165445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:36.166591 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=8 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:36.171795 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec4603fc-9bf5-4418-86b8-4def9a5b1100 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:36.172689 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec4603fc-9bf5-4418-86b8-4def9a5b1100 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:36.172821 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec4603fc-9bf5-4418-86b8-4def9a5b1100 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:36.173400 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec4603fc-9bf5-4418-86b8-4def9a5b1100 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:36.173850 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec4603fc-9bf5-4418-86b8-4def9a5b1100 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:36.174273 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec4603fc-9bf5-4418-86b8-4def9a5b1100 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:36.302157 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ec4603fc-9bf5-4418-86b8-4def9a5b1100 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:36.310602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ec4603fc-9bf5-4418-86b8-4def9a5b1100 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.151367 Aug 24 17:01:36.311162 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 537/1076] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:36 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:37.331138 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1251ee82-068a-4099-9736-c2187d4a4e87 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:37.331746 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1251ee82-068a-4099-9736-c2187d4a4e87 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:37.338146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1251ee82-068a-4099-9736-c2187d4a4e87 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:37.338628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1251ee82-068a-4099-9736-c2187d4a4e87 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:37.339057 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1251ee82-068a-4099-9736-c2187d4a4e87 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:37.339739 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1251ee82-068a-4099-9736-c2187d4a4e87 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:37.340183 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1251ee82-068a-4099-9736-c2187d4a4e87 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:37.340632 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1251ee82-068a-4099-9736-c2187d4a4e87 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:37.469718 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1251ee82-068a-4099-9736-c2187d4a4e87 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:37.477301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1251ee82-068a-4099-9736-c2187d4a4e87 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.149995 Aug 24 17:01:37.480073 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 540/1077] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:37 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:01:38.499220 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9c83e55a-1ded-4b69-af45-f6f88d63fbcf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:38.499837 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9c83e55a-1ded-4b69-af45-f6f88d63fbcf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:38.506533 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9c83e55a-1ded-4b69-af45-f6f88d63fbcf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:38.507015 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9c83e55a-1ded-4b69-af45-f6f88d63fbcf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:38.507448 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9c83e55a-1ded-4b69-af45-f6f88d63fbcf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:38.508137 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9c83e55a-1ded-4b69-af45-f6f88d63fbcf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:38.508628 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9c83e55a-1ded-4b69-af45-f6f88d63fbcf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:38.509059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9c83e55a-1ded-4b69-af45-f6f88d63fbcf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:38.644021 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9c83e55a-1ded-4b69-af45-f6f88d63fbcf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:38.651623 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9c83e55a-1ded-4b69-af45-f6f88d63fbcf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.157063 Aug 24 17:01:38.652185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 538/1078] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:38 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:39.681639 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-22f87188-a939-420d-8a1e-228e61f23f62 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:39.682289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-22f87188-a939-420d-8a1e-228e61f23f62 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:39.689234 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22f87188-a939-420d-8a1e-228e61f23f62 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:39.689717 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22f87188-a939-420d-8a1e-228e61f23f62 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:39.690151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22f87188-a939-420d-8a1e-228e61f23f62 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:39.690836 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22f87188-a939-420d-8a1e-228e61f23f62 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:39.691289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22f87188-a939-420d-8a1e-228e61f23f62 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:39.691710 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22f87188-a939-420d-8a1e-228e61f23f62 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:39.825520 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-22f87188-a939-420d-8a1e-228e61f23f62 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:39.833552 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-22f87188-a939-420d-8a1e-228e61f23f62 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.155862 Aug 24 17:01:39.834310 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 541/1079] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:39 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:40.855943 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b872c28b-8daa-4b50-99ba-54e9cb8fd038 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:40.856681 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b872c28b-8daa-4b50-99ba-54e9cb8fd038 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:40.863332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b872c28b-8daa-4b50-99ba-54e9cb8fd038 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:40.863830 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b872c28b-8daa-4b50-99ba-54e9cb8fd038 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:40.864266 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b872c28b-8daa-4b50-99ba-54e9cb8fd038 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:40.865028 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b872c28b-8daa-4b50-99ba-54e9cb8fd038 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:40.865489 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b872c28b-8daa-4b50-99ba-54e9cb8fd038 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:40.865922 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b872c28b-8daa-4b50-99ba-54e9cb8fd038 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:40.995009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b872c28b-8daa-4b50-99ba-54e9cb8fd038 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:41.002709 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b872c28b-8daa-4b50-99ba-54e9cb8fd038 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.151255 Aug 24 17:01:41.003272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 539/1080] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:40 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:42.023157 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b1458146-9e3e-485c-91b0-6b610242c5cb tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:42.023772 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b1458146-9e3e-485c-91b0-6b610242c5cb tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:42.030262 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1458146-9e3e-485c-91b0-6b610242c5cb tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:42.030738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1458146-9e3e-485c-91b0-6b610242c5cb tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:42.031168 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1458146-9e3e-485c-91b0-6b610242c5cb tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:42.031853 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1458146-9e3e-485c-91b0-6b610242c5cb tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:42.032303 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1458146-9e3e-485c-91b0-6b610242c5cb tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:42.032762 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1458146-9e3e-485c-91b0-6b610242c5cb tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:42.159255 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b1458146-9e3e-485c-91b0-6b610242c5cb tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:42.167281 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b1458146-9e3e-485c-91b0-6b610242c5cb tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.147542 Aug 24 17:01:42.167843 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 542/1081] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:42 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:43.187712 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ce02ab96-1c45-46cb-a934-fced9b3b6a73 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:43.188339 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ce02ab96-1c45-46cb-a934-fced9b3b6a73 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:43.194718 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce02ab96-1c45-46cb-a934-fced9b3b6a73 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:43.195205 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce02ab96-1c45-46cb-a934-fced9b3b6a73 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:43.195643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce02ab96-1c45-46cb-a934-fced9b3b6a73 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:43.196332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce02ab96-1c45-46cb-a934-fced9b3b6a73 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:43.196868 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce02ab96-1c45-46cb-a934-fced9b3b6a73 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:43.197295 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ce02ab96-1c45-46cb-a934-fced9b3b6a73 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:43.325126 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ce02ab96-1c45-46cb-a934-fced9b3b6a73 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:43.332812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ce02ab96-1c45-46cb-a934-fced9b3b6a73 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.148990 Aug 24 17:01:43.333381 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 540/1082] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:43 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:44.353681 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-209f7b2a-f064-49b1-986d-3952190c6b85 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:44.354355 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-209f7b2a-f064-49b1-986d-3952190c6b85 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:44.360748 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-209f7b2a-f064-49b1-986d-3952190c6b85 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:44.361228 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-209f7b2a-f064-49b1-986d-3952190c6b85 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:44.361659 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-209f7b2a-f064-49b1-986d-3952190c6b85 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:44.362342 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-209f7b2a-f064-49b1-986d-3952190c6b85 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:44.362794 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-209f7b2a-f064-49b1-986d-3952190c6b85 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:44.363214 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-209f7b2a-f064-49b1-986d-3952190c6b85 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:44.488760 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-209f7b2a-f064-49b1-986d-3952190c6b85 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:44.496348 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-209f7b2a-f064-49b1-986d-3952190c6b85 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.146544 Aug 24 17:01:44.496931 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 543/1083] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:44 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:45.517073 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1d7dae8a-a2c8-49e8-af01-9c486f1dfb77 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:45.517692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1d7dae8a-a2c8-49e8-af01-9c486f1dfb77 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:45.524313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d7dae8a-a2c8-49e8-af01-9c486f1dfb77 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:45.527101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d7dae8a-a2c8-49e8-af01-9c486f1dfb77 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:45.527101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d7dae8a-a2c8-49e8-af01-9c486f1dfb77 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:45.527101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d7dae8a-a2c8-49e8-af01-9c486f1dfb77 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:45.527101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d7dae8a-a2c8-49e8-af01-9c486f1dfb77 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:45.527483 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1d7dae8a-a2c8-49e8-af01-9c486f1dfb77 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:45.664553 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1d7dae8a-a2c8-49e8-af01-9c486f1dfb77 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:45.668098 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1d7dae8a-a2c8-49e8-af01-9c486f1dfb77 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.154890 Aug 24 17:01:45.668687 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 541/1084] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:45 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:46.689257 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d2f82e20-1dde-4ff4-92c5-7dd44ab92ba4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:46.689871 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d2f82e20-1dde-4ff4-92c5-7dd44ab92ba4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:46.696372 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2f82e20-1dde-4ff4-92c5-7dd44ab92ba4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:46.696900 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2f82e20-1dde-4ff4-92c5-7dd44ab92ba4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:46.697338 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2f82e20-1dde-4ff4-92c5-7dd44ab92ba4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:46.698038 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2f82e20-1dde-4ff4-92c5-7dd44ab92ba4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:46.698491 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2f82e20-1dde-4ff4-92c5-7dd44ab92ba4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:46.698914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2f82e20-1dde-4ff4-92c5-7dd44ab92ba4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:46.825075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d2f82e20-1dde-4ff4-92c5-7dd44ab92ba4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:46.832719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d2f82e20-1dde-4ff4-92c5-7dd44ab92ba4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.147338 Aug 24 17:01:46.833281 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 544/1085] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:46 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:47.281172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-89532a07-8ec3-4b0b-a51c-c610333332d5 req-cdce7bae-0ae6-4b1c-86c8-03b01300952f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9129ed01-364e-4c0b-ad15-040bdaaaec13", "name": "network-vif-plugged", "status": "completed", "tag": "36e5522b-8ad1-4469-99a6-9ee02971e5ff"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:01:47.291547 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-89532a07-8ec3-4b0b-a51c-c610333332d5 req-cdce7bae-0ae6-4b1c-86c8-03b01300952f service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:47.294568 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-89532a07-8ec3-4b0b-a51c-c610333332d5 req-cdce7bae-0ae6-4b1c-86c8-03b01300952f service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:47.294568 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-89532a07-8ec3-4b0b-a51c-c610333332d5 req-cdce7bae-0ae6-4b1c-86c8-03b01300952f service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:47.304140 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-89532a07-8ec3-4b0b-a51c-c610333332d5 req-cdce7bae-0ae6-4b1c-86c8-03b01300952f service nova] Creating event network-vif-plugged:36e5522b-8ad1-4469-99a6-9ee02971e5ff for instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 on hv-cinder-85220 Aug 24 17:01:47.309234 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-89532a07-8ec3-4b0b-a51c-c610333332d5 req-cdce7bae-0ae6-4b1c-86c8-03b01300952f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031694 Aug 24 17:01:47.309852 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 542/1086] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:01:47.852740 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-62f8cb45-c162-4e71-9d1c-21cc69c9486d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:47.853363 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-62f8cb45-c162-4e71-9d1c-21cc69c9486d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:47.859933 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62f8cb45-c162-4e71-9d1c-21cc69c9486d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:47.860435 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62f8cb45-c162-4e71-9d1c-21cc69c9486d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:47.860882 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62f8cb45-c162-4e71-9d1c-21cc69c9486d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:47.861575 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62f8cb45-c162-4e71-9d1c-21cc69c9486d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:47.862022 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62f8cb45-c162-4e71-9d1c-21cc69c9486d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:47.862441 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62f8cb45-c162-4e71-9d1c-21cc69c9486d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:47.989798 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-62f8cb45-c162-4e71-9d1c-21cc69c9486d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:47.997795 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-62f8cb45-c162-4e71-9d1c-21cc69c9486d tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.148891 Aug 24 17:01:47.998352 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 545/1087] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:47 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:49.019862 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a39c6d0b-891d-45c0-b71b-de3ce7912df7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:49.020586 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a39c6d0b-891d-45c0-b71b-de3ce7912df7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:49.027037 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a39c6d0b-891d-45c0-b71b-de3ce7912df7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:49.027515 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a39c6d0b-891d-45c0-b71b-de3ce7912df7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:49.027979 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a39c6d0b-891d-45c0-b71b-de3ce7912df7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:49.029217 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a39c6d0b-891d-45c0-b71b-de3ce7912df7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:49.029668 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a39c6d0b-891d-45c0-b71b-de3ce7912df7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:49.030090 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a39c6d0b-891d-45c0-b71b-de3ce7912df7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:49.157144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a39c6d0b-891d-45c0-b71b-de3ce7912df7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:49.164665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a39c6d0b-891d-45c0-b71b-de3ce7912df7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1358 microversion: 2.1 time: 0.148922 Aug 24 17:01:49.165211 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 543/1088] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:49 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:50.185278 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1ad8fd7e-eebf-4668-bb6f-3dc4121bf439 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:50.185903 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1ad8fd7e-eebf-4668-bb6f-3dc4121bf439 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:50.192502 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ad8fd7e-eebf-4668-bb6f-3dc4121bf439 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:50.192995 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ad8fd7e-eebf-4668-bb6f-3dc4121bf439 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:50.193433 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ad8fd7e-eebf-4668-bb6f-3dc4121bf439 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:50.194129 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ad8fd7e-eebf-4668-bb6f-3dc4121bf439 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:50.194583 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ad8fd7e-eebf-4668-bb6f-3dc4121bf439 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:50.195009 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ad8fd7e-eebf-4668-bb6f-3dc4121bf439 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:50.320580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1ad8fd7e-eebf-4668-bb6f-3dc4121bf439 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:50.328718 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1ad8fd7e-eebf-4668-bb6f-3dc4121bf439 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1548 microversion: 2.1 time: 0.147359 Aug 24 17:01:50.329277 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 546/1089] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:50 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:50.348968 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ccd1ada3-9d2d-4749-8ffb-f9658b4097b6 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:50.349618 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ccd1ada3-9d2d-4749-8ffb-f9658b4097b6 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:50.355886 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccd1ada3-9d2d-4749-8ffb-f9658b4097b6 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:50.356369 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccd1ada3-9d2d-4749-8ffb-f9658b4097b6 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:50.356844 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccd1ada3-9d2d-4749-8ffb-f9658b4097b6 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:50.357537 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccd1ada3-9d2d-4749-8ffb-f9658b4097b6 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:50.357995 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccd1ada3-9d2d-4749-8ffb-f9658b4097b6 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:50.358424 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ccd1ada3-9d2d-4749-8ffb-f9658b4097b6 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:50.485479 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ccd1ada3-9d2d-4749-8ffb-f9658b4097b6 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:50.493200 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ccd1ada3-9d2d-4749-8ffb-f9658b4097b6 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1548 microversion: 2.1 time: 0.148070 Aug 24 17:01:50.493765 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 544/1090] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:50 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:50.513597 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-134c6161-128c-4575-80b4-4ce66755d7a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:50.518196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-134c6161-128c-4575-80b4-4ce66755d7a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:50.518968 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-134c6161-128c-4575-80b4-4ce66755d7a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Searching by: {'deleted': False, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc'} {{(pid=127716) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 17:01:50.525509 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-134c6161-128c-4575-80b4-4ce66755d7a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:50.525990 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-134c6161-128c-4575-80b4-4ce66755d7a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:50.526426 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-134c6161-128c-4575-80b4-4ce66755d7a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:50.527153 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-134c6161-128c-4575-80b4-4ce66755d7a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:50.527604 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-134c6161-128c-4575-80b4-4ce66755d7a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:50.528787 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-134c6161-128c-4575-80b4-4ce66755d7a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:50.615887 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.multi_cell_list [None req-134c6161-128c-4575-80b4-4ce66755d7a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 17:01:50.709053 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-134c6161-128c-4575-80b4-4ce66755d7a9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.199656 Aug 24 17:01:50.709550 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 547/1091] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Aug 24 17:01:50 2022] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:01:50.720881 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8e16493d-feb9-4016-8478-bf0f98389a44 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:01:50.721499 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8e16493d-feb9-4016-8478-bf0f98389a44 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:50.727414 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8e16493d-feb9-4016-8478-bf0f98389a44 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:50.727893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8e16493d-feb9-4016-8478-bf0f98389a44 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:50.728327 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8e16493d-feb9-4016-8478-bf0f98389a44 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:50.729047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8e16493d-feb9-4016-8478-bf0f98389a44 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:50.729500 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8e16493d-feb9-4016-8478-bf0f98389a44 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:50.729924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8e16493d-feb9-4016-8478-bf0f98389a44 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:50.857355 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8e16493d-feb9-4016-8478-bf0f98389a44 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:01:50.865006 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8e16493d-feb9-4016-8478-bf0f98389a44 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1548 microversion: 2.1 time: 0.148178 Aug 24 17:01:50.865571 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 545/1092] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:01:50 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:01:52.744262 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-40167d60-b5f1-4c6d-8fc9-e15632297996 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e31b17a-f3b7-4f46-ac98-6b16238c3d00"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:01:52.746644 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-40167d60-b5f1-4c6d-8fc9-e15632297996 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:01:52.754185 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40167d60-b5f1-4c6d-8fc9-e15632297996 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:52.754824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40167d60-b5f1-4c6d-8fc9-e15632297996 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:52.755569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40167d60-b5f1-4c6d-8fc9-e15632297996 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:52.756259 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40167d60-b5f1-4c6d-8fc9-e15632297996 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:01:52.756738 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40167d60-b5f1-4c6d-8fc9-e15632297996 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:01:52.757155 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40167d60-b5f1-4c6d-8fc9-e15632297996 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:01:53.407812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-40167d60-b5f1-4c6d-8fc9-e15632297996 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "POST /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.667353 Aug 24 17:01:53.408494 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 548/1093] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 17:01:52 2022] POST /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/os-volume_attachments => generated 194 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:02:02.027201 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8f72f39f-baf9-4ff7-9990-2238c314f923 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:02.027804 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8f72f39f-baf9-4ff7-9990-2238c314f923 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:02.030385 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:02.031047 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=76 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:02.035603 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f72f39f-baf9-4ff7-9990-2238c314f923 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:02.036082 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f72f39f-baf9-4ff7-9990-2238c314f923 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:02.036545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f72f39f-baf9-4ff7-9990-2238c314f923 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:02.037232 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f72f39f-baf9-4ff7-9990-2238c314f923 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:02.037680 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f72f39f-baf9-4ff7-9990-2238c314f923 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:02.038101 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f72f39f-baf9-4ff7-9990-2238c314f923 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:02.170961 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8f72f39f-baf9-4ff7-9990-2238c314f923 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:02.179391 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8f72f39f-baf9-4ff7-9990-2238c314f923 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1594 microversion: 2.1 time: 0.156031 Aug 24 17:02:02.179950 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 546/1094] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:02 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:04.712209 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:04.713289 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:04.714017 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:04.718680 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-605caced-878d-4293-bcab-46a02da78418 req-6b94cc4d-e3bc-4004-9de1-5a6bbe464ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9129ed01-364e-4c0b-ad15-040bdaaaec13", "tag": "36e5522b-8ad1-4469-99a6-9ee02971e5ff"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:02:04.728359 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-605caced-878d-4293-bcab-46a02da78418 req-6b94cc4d-e3bc-4004-9de1-5a6bbe464ecc service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:04.731746 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-605caced-878d-4293-bcab-46a02da78418 req-6b94cc4d-e3bc-4004-9de1-5a6bbe464ecc service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:04.731746 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-605caced-878d-4293-bcab-46a02da78418 req-6b94cc4d-e3bc-4004-9de1-5a6bbe464ecc service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:04.741114 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-605caced-878d-4293-bcab-46a02da78418 req-6b94cc4d-e3bc-4004-9de1-5a6bbe464ecc service nova] Creating event network-changed:36e5522b-8ad1-4469-99a6-9ee02971e5ff for instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 on hv-cinder-85220 Aug 24 17:02:04.746291 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-605caced-878d-4293-bcab-46a02da78418 req-6b94cc4d-e3bc-4004-9de1-5a6bbe464ecc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035343 Aug 24 17:02:04.746773 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 549/1095] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:02:07.088115 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7cea6dd7-945b-4bc6-80ac-94563eff65c4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-223832531"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:02:07.088705 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7cea6dd7-945b-4bc6-80ac-94563eff65c4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:07.095634 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7cea6dd7-945b-4bc6-80ac-94563eff65c4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:07.096113 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7cea6dd7-945b-4bc6-80ac-94563eff65c4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:07.096599 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7cea6dd7-945b-4bc6-80ac-94563eff65c4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:07.097289 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7cea6dd7-945b-4bc6-80ac-94563eff65c4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:07.097744 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7cea6dd7-945b-4bc6-80ac-94563eff65c4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:07.098192 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7cea6dd7-945b-4bc6-80ac-94563eff65c4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:07.225203 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.network.security_group_api [None req-7cea6dd7-945b-4bc6-80ac-94563eff65c4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Adding security group ce0b190a-50e1-4ae9-9bbf-6d35787ed3d5 to port 36e5522b-8ad1-4469-99a6-9ee02971e5ff Aug 24 17:02:07.607721 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7cea6dd7-945b-4bc6-80ac-94563eff65c4 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "POST /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/action" status: 202 len: 0 microversion: 2.1 time: 0.522840 Aug 24 17:02:07.616751 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 547/1096] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 17:02:07 2022] POST /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:02:07.618381 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-612e8213-cc7b-407c-94f7-5b2a11509fe5 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:07.619085 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-612e8213-cc7b-407c-94f7-5b2a11509fe5 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:07.632681 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-6529949e-2fca-4149-bfc0-f05b55cf1a25 req-f241cff9-7588-423a-bbec-48215fcec7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9129ed01-364e-4c0b-ad15-040bdaaaec13", "tag": "36e5522b-8ad1-4469-99a6-9ee02971e5ff"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:02:07.639657 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-612e8213-cc7b-407c-94f7-5b2a11509fe5 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:07.640146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-612e8213-cc7b-407c-94f7-5b2a11509fe5 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:07.640641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-612e8213-cc7b-407c-94f7-5b2a11509fe5 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:07.641392 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-612e8213-cc7b-407c-94f7-5b2a11509fe5 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:07.641846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-612e8213-cc7b-407c-94f7-5b2a11509fe5 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:07.643122 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-6529949e-2fca-4149-bfc0-f05b55cf1a25 req-f241cff9-7588-423a-bbec-48215fcec7e7 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:07.643989 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-6529949e-2fca-4149-bfc0-f05b55cf1a25 req-f241cff9-7588-423a-bbec-48215fcec7e7 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:07.644871 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-612e8213-cc7b-407c-94f7-5b2a11509fe5 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:07.645062 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-6529949e-2fca-4149-bfc0-f05b55cf1a25 req-f241cff9-7588-423a-bbec-48215fcec7e7 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:07.657327 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-6529949e-2fca-4149-bfc0-f05b55cf1a25 req-f241cff9-7588-423a-bbec-48215fcec7e7 service nova] Creating event network-changed:36e5522b-8ad1-4469-99a6-9ee02971e5ff for instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 on hv-cinder-85220 Aug 24 17:02:07.662888 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-6529949e-2fca-4149-bfc0-f05b55cf1a25 req-f241cff9-7588-423a-bbec-48215fcec7e7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034045 Aug 24 17:02:07.663630 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 548/1097] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:02:07.807370 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-612e8213-cc7b-407c-94f7-5b2a11509fe5 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:07.816044 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-612e8213-cc7b-407c-94f7-5b2a11509fe5 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1758 microversion: 2.1 time: 0.203186 Aug 24 17:02:07.816915 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 550/1098] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:07 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:27.409129 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=6 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:27.409877 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=12 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:27.413938 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-111b943e-ea19-4520-8cde-5791ef8cfc1d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:27.414511 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-111b943e-ea19-4520-8cde-5791ef8cfc1d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:27.420325 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-111b943e-ea19-4520-8cde-5791ef8cfc1d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:27.420844 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-111b943e-ea19-4520-8cde-5791ef8cfc1d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:27.421275 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-111b943e-ea19-4520-8cde-5791ef8cfc1d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:27.421959 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-111b943e-ea19-4520-8cde-5791ef8cfc1d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:27.422436 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-111b943e-ea19-4520-8cde-5791ef8cfc1d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:27.422859 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-111b943e-ea19-4520-8cde-5791ef8cfc1d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:27.445655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-111b943e-ea19-4520-8cde-5791ef8cfc1d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/ips" status: 200 len: 143 microversion: 2.1 time: 0.038113 Aug 24 17:02:27.446207 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 549/1099] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Aug 24 17:02:27 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/ips => generated 143 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:02:31.237223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b45f8135-54f6-48ef-a7c7-c9b7255180e8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86f31d35-bde4-4f8d-80f6-6bd25b0e253c"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:02:31.239612 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b45f8135-54f6-48ef-a7c7-c9b7255180e8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:31.241814 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=4 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:31.242451 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=8 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:31.247046 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b45f8135-54f6-48ef-a7c7-c9b7255180e8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:31.247520 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b45f8135-54f6-48ef-a7c7-c9b7255180e8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:31.247997 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b45f8135-54f6-48ef-a7c7-c9b7255180e8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:31.248709 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b45f8135-54f6-48ef-a7c7-c9b7255180e8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:31.249178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b45f8135-54f6-48ef-a7c7-c9b7255180e8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:31.249595 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b45f8135-54f6-48ef-a7c7-c9b7255180e8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:31.955819 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b45f8135-54f6-48ef-a7c7-c9b7255180e8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "POST /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.722873 Aug 24 17:02:31.956449 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 551/1100] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 17:02:31 2022] POST /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/os-volume_attachments => generated 194 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:02:39.436957 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b10546eb-4b4e-46c1-90e3-835860049b66 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:39.437470 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b10546eb-4b4e-46c1-90e3-835860049b66 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:39.444490 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b10546eb-4b4e-46c1-90e3-835860049b66 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:39.446432 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b10546eb-4b4e-46c1-90e3-835860049b66 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:39.446432 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b10546eb-4b4e-46c1-90e3-835860049b66 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:39.446432 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b10546eb-4b4e-46c1-90e3-835860049b66 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:39.446757 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b10546eb-4b4e-46c1-90e3-835860049b66 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:39.446987 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b10546eb-4b4e-46c1-90e3-835860049b66 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:39.474342 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b10546eb-4b4e-46c1-90e3-835860049b66 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Going to try to terminate instance {{(pid=127715) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:02:39.517752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ca8d0b90-3bb8-478d-b84a-8b0a2ffcbaa2 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:02:39.523938 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca8d0b90-3bb8-478d-b84a-8b0a2ffcbaa2 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:39.524447 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca8d0b90-3bb8-478d-b84a-8b0a2ffcbaa2 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:39.524895 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca8d0b90-3bb8-478d-b84a-8b0a2ffcbaa2 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:39.585580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ca8d0b90-3bb8-478d-b84a-8b0a2ffcbaa2 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Going to try to stop instance {{(pid=127716) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 17:02:39.791667 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b10546eb-4b4e-46c1-90e3-835860049b66 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "DELETE /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 204 len: 0 microversion: 2.1 time: 0.359747 Aug 24 17:02:39.792182 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 550/1101] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 17:02:39 2022] DELETE /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:02:39.800910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0832e611-be38-44df-8398-c206283c2e6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:39.813878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0832e611-be38-44df-8398-c206283c2e6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:39.813878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0832e611-be38-44df-8398-c206283c2e6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:39.813878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0832e611-be38-44df-8398-c206283c2e6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:39.813878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0832e611-be38-44df-8398-c206283c2e6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:39.814320 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0832e611-be38-44df-8398-c206283c2e6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:39.814320 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0832e611-be38-44df-8398-c206283c2e6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:39.814320 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0832e611-be38-44df-8398-c206283c2e6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:39.834719 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ca8d0b90-3bb8-478d-b84a-8b0a2ffcbaa2 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "POST /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/action" status: 202 len: 0 microversion: 2.1 time: 0.322165 Aug 24 17:02:39.835459 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 552/1102] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 17:02:39 2022] POST /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:02:39.843741 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4cf6f93d-6ce6-48e6-ad45-b3b6eccd1948 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:39.846240 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4cf6f93d-6ce6-48e6-ad45-b3b6eccd1948 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:39.850711 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4cf6f93d-6ce6-48e6-ad45-b3b6eccd1948 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:39.851198 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4cf6f93d-6ce6-48e6-ad45-b3b6eccd1948 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:39.851645 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4cf6f93d-6ce6-48e6-ad45-b3b6eccd1948 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:39.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4cf6f93d-6ce6-48e6-ad45-b3b6eccd1948 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:39.852884 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4cf6f93d-6ce6-48e6-ad45-b3b6eccd1948 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:39.853315 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4cf6f93d-6ce6-48e6-ad45-b3b6eccd1948 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:39.996358 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0832e611-be38-44df-8398-c206283c2e6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:40.005107 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0832e611-be38-44df-8398-c206283c2e6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1577 microversion: 2.1 time: 0.207898 Aug 24 17:02:40.005674 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 551/1103] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:39 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1577 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:02:40.017581 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4cf6f93d-6ce6-48e6-ad45-b3b6eccd1948 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:40.025861 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4cf6f93d-6ce6-48e6-ad45-b3b6eccd1948 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1719 microversion: 2.1 time: 0.186135 Aug 24 17:02:40.026427 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 553/1104] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:39 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1719 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:02:41.025815 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8797d9b9-a590-4436-b8e0-99d0e1e2bcf4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:41.026458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8797d9b9-a590-4436-b8e0-99d0e1e2bcf4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:41.032886 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8797d9b9-a590-4436-b8e0-99d0e1e2bcf4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:41.033372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8797d9b9-a590-4436-b8e0-99d0e1e2bcf4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:41.033807 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8797d9b9-a590-4436-b8e0-99d0e1e2bcf4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:41.034502 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8797d9b9-a590-4436-b8e0-99d0e1e2bcf4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:41.034958 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8797d9b9-a590-4436-b8e0-99d0e1e2bcf4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:41.035384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8797d9b9-a590-4436-b8e0-99d0e1e2bcf4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:41.046934 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6b61ee5b-83d2-41b9-a7af-b43348426f73 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:41.047566 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6b61ee5b-83d2-41b9-a7af-b43348426f73 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:41.054086 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b61ee5b-83d2-41b9-a7af-b43348426f73 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:41.054558 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b61ee5b-83d2-41b9-a7af-b43348426f73 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:41.054986 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b61ee5b-83d2-41b9-a7af-b43348426f73 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:41.055670 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b61ee5b-83d2-41b9-a7af-b43348426f73 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:41.056118 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b61ee5b-83d2-41b9-a7af-b43348426f73 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:41.056619 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b61ee5b-83d2-41b9-a7af-b43348426f73 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:41.232497 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8797d9b9-a590-4436-b8e0-99d0e1e2bcf4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:41.239919 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6b61ee5b-83d2-41b9-a7af-b43348426f73 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:41.240805 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8797d9b9-a590-4436-b8e0-99d0e1e2bcf4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1577 microversion: 2.1 time: 0.218879 Aug 24 17:02:41.241376 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 552/1105] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:41 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1577 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:41.248180 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6b61ee5b-83d2-41b9-a7af-b43348426f73 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1719 microversion: 2.1 time: 0.205016 Aug 24 17:02:41.249344 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 554/1106] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:41 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1719 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:02:42.262004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2a4f158b-b598-4022-9a56-e71b37aa847f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:42.262625 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2a4f158b-b598-4022-9a56-e71b37aa847f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:42.269780 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a4f158b-b598-4022-9a56-e71b37aa847f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:42.270260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a4f158b-b598-4022-9a56-e71b37aa847f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:42.270436 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c27fa976-d439-4b66-b33a-b921c4620d08 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:42.270858 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a4f158b-b598-4022-9a56-e71b37aa847f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:42.270957 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c27fa976-d439-4b66-b33a-b921c4620d08 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:42.271383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a4f158b-b598-4022-9a56-e71b37aa847f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:42.272024 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a4f158b-b598-4022-9a56-e71b37aa847f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:42.272475 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2a4f158b-b598-4022-9a56-e71b37aa847f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:42.277356 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c27fa976-d439-4b66-b33a-b921c4620d08 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:42.278149 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c27fa976-d439-4b66-b33a-b921c4620d08 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:42.278803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c27fa976-d439-4b66-b33a-b921c4620d08 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:42.279603 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c27fa976-d439-4b66-b33a-b921c4620d08 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:42.280682 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c27fa976-d439-4b66-b33a-b921c4620d08 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:42.281201 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c27fa976-d439-4b66-b33a-b921c4620d08 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:42.362584 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2a4f158b-b598-4022-9a56-e71b37aa847f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:42.371024 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2a4f158b-b598-4022-9a56-e71b37aa847f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1510 microversion: 2.1 time: 0.112837 Aug 24 17:02:42.372123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 553/1107] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:42 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1510 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:42.440907 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c27fa976-d439-4b66-b33a-b921c4620d08 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:42.450592 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c27fa976-d439-4b66-b33a-b921c4620d08 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1719 microversion: 2.1 time: 0.184511 Aug 24 17:02:42.452181 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 555/1108] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:42 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1719 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:42.469759 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-edfe4ead-334f-445f-bc9f-23026f4867f0 req-c608bccf-fcff-4c97-9f74-b75f74fe2b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63aaebc2-8a55-4615-a3e7-7ac0dca58edf", "name": "network-vif-deleted", "tag": "583f3e4f-cc38-42cf-a81e-3d86bb5ab443"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:02:42.479442 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-edfe4ead-334f-445f-bc9f-23026f4867f0 req-c608bccf-fcff-4c97-9f74-b75f74fe2b22 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:42.480112 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-edfe4ead-334f-445f-bc9f-23026f4867f0 req-c608bccf-fcff-4c97-9f74-b75f74fe2b22 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:42.480620 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-edfe4ead-334f-445f-bc9f-23026f4867f0 req-c608bccf-fcff-4c97-9f74-b75f74fe2b22 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:42.491945 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-edfe4ead-334f-445f-bc9f-23026f4867f0 req-c608bccf-fcff-4c97-9f74-b75f74fe2b22 service nova] Creating event network-vif-deleted:583f3e4f-cc38-42cf-a81e-3d86bb5ab443 for instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf on hv-cinder-85220 Aug 24 17:02:42.497732 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-edfe4ead-334f-445f-bc9f-23026f4867f0 req-c608bccf-fcff-4c97-9f74-b75f74fe2b22 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031158 Aug 24 17:02:42.501802 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 554/1109] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:02:43.393325 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:43.393938 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:43.400041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:43.400549 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:43.400983 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:43.401674 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:43.402158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:43.402540 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:43.435906 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:43.436294 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:43.436755 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:43.437193 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lazy-loading 'fault' on Instance uuid 63aaebc2-8a55-4615-a3e7-7ac0dca58edf {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:02:43.474775 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5e6e0d5a-7185-4e84-9039-744e1b55fb2a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:43.475756 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5e6e0d5a-7185-4e84-9039-744e1b55fb2a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:43.478566 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:43.482643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e6e0d5a-7185-4e84-9039-744e1b55fb2a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:43.483123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e6e0d5a-7185-4e84-9039-744e1b55fb2a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:43.483555 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e6e0d5a-7185-4e84-9039-744e1b55fb2a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:43.484246 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e6e0d5a-7185-4e84-9039-744e1b55fb2a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:43.484725 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e6e0d5a-7185-4e84-9039-744e1b55fb2a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:43.485150 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5e6e0d5a-7185-4e84-9039-744e1b55fb2a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:43.486661 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7a71e841-c246-4502-b9c5-50e34a1930a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 200 len: 1231 microversion: 2.1 time: 0.097654 Aug 24 17:02:43.498337 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 556/1110] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:43 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:43.616957 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-5e6e0d5a-7185-4e84-9039-744e1b55fb2a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:43.625237 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5e6e0d5a-7185-4e84-9039-744e1b55fb2a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1719 microversion: 2.1 time: 0.155141 Aug 24 17:02:43.625848 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 555/1111] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:43 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:02:44.507833 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-786be651-f9db-4544-b8ef-4bda6e985855 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:44.508470 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-786be651-f9db-4544-b8ef-4bda6e985855 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:44.514790 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-786be651-f9db-4544-b8ef-4bda6e985855 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:44.515270 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-786be651-f9db-4544-b8ef-4bda6e985855 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:44.515701 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-786be651-f9db-4544-b8ef-4bda6e985855 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:44.516389 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-786be651-f9db-4544-b8ef-4bda6e985855 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:44.516899 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-786be651-f9db-4544-b8ef-4bda6e985855 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:44.517325 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-786be651-f9db-4544-b8ef-4bda6e985855 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:44.531348 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-786be651-f9db-4544-b8ef-4bda6e985855 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] HTTP exception thrown: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-786be651-f9db-4544-b8ef-4bda6e985855 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Request method failure captured: Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf HTTP/1.1 Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlijBbk2OFKfNW9n0JDtNbrOD1V5gSg_Z7lqVZ0UtERqNjaty6_5Fsg-xF4h7HqVMhCWZMh7YeuHNGU66z_YHZyvqKrBbHCMhFWp_j7qLSDUBTwDVxsIdAriuN7ViyOVkCR6jAC6X-6GoHuLVM7bG1Z7kifFnKa-ZNuAUGeSja66JLc Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 805d6de24ff4415c89cba2d318ffd2f4 Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 17:02:44.533006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 17:02:44.534723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:02:44.534723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:02:44.534723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 805d6de24ff4415c89cba2d318ffd2f4 Aug 24 17:02:44.534723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:02:44.534723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-TestVolumeBootPattern-1985410155-project Aug 24 17:02:44.534723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 17:02:44.534723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 17:02:44.534723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 701be5a3cff34016ab22b6dc4d23d939 Aug 24 17:02:44.534723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-TestVolumeBootPattern-1985410155-project Aug 24 17:02:44.534723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 17:02:44.534723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:02:44.534723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '63aaebc2-8a55-4615-a3e7-7ac0dca58edf'} Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:02:44.535754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:02:44.537476 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:02:44.538955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-786be651-f9db-4544-b8ef-4bda6e985855 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Returning 404 to user: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:02:44.538955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-786be651-f9db-4544-b8ef-4bda6e985855 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 404 len: 111 microversion: 2.1 time: 0.030719 Aug 24 17:02:44.538955 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 557/1112] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:44 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:02:44.629181 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-157895658", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1973815301", "security_groups": [{"name": "tempest-secgroup-smoke-647078182"}], "block_device_mapping_v2": [{"uuid": "9cd59e31-936e-431a-b52e-bac4264e1ed1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b92bc0ae-a252-4a61-8a0b-b9b8262f1ac3"}]}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:02:44.646509 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-07e383ba-6ce9-4d73-bf64-b69289e3e07e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:44.647127 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-07e383ba-6ce9-4d73-bf64-b69289e3e07e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:44.653011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e383ba-6ce9-4d73-bf64-b69289e3e07e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:44.653493 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e383ba-6ce9-4d73-bf64-b69289e3e07e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:44.653930 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e383ba-6ce9-4d73-bf64-b69289e3e07e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:44.655127 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e383ba-6ce9-4d73-bf64-b69289e3e07e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:44.655612 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e383ba-6ce9-4d73-bf64-b69289e3e07e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:44.656036 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e383ba-6ce9-4d73-bf64-b69289e3e07e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:44.788478 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.network.neutron [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] validate_networks() for [('b92bc0ae-a252-4a61-8a0b-b9b8262f1ac3', None, None, None, None, None)] {{(pid=127715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:02:44.835956 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-07e383ba-6ce9-4d73-bf64-b69289e3e07e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:44.844766 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-07e383ba-6ce9-4d73-bf64-b69289e3e07e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1719 microversion: 2.1 time: 0.201965 Aug 24 17:02:44.845338 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 558/1113] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:44 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1719 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:02:45.158641 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Flavor limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:02:45.159069 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Image limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:02:45.159548 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Flavor pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:02:45.159984 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Image pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:02:45.160422 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:02:45.168999 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:45.169482 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:45.169917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:45.170689 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:45.171145 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:45.171570 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:45.187955 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Getting quotas for project 805d6de24ff4415c89cba2d318ffd2f4. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:02:45.191803 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Getting quotas for user 701be5a3cff34016ab22b6dc4d23d939 and project 805d6de24ff4415c89cba2d318ffd2f4. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:02:45.247133 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Going to run 1 instances... {{(pid=127715) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:02:45.249365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9cd59e31-936e-431a-b52e-bac4264e1ed1',volume_size=None,volume_type=None)] {{(pid=127715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:02:45.664109 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a5407f36-ac27-42d8-85f3-1246fde67477 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.038723 Aug 24 17:02:45.668456 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 556/1114] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 17:02:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:02:45.675811 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bd358dd6-be4c-498e-bc17-e14ba6906ace tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:45.676644 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bd358dd6-be4c-498e-bc17-e14ba6906ace tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:45.728515 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bd358dd6-be4c-498e-bc17-e14ba6906ace tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:45.736236 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bd358dd6-be4c-498e-bc17-e14ba6906ace tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1094 microversion: 2.1 time: 0.064218 Aug 24 17:02:45.736842 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 559/1115] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:45 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:45.866274 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8db4b1e7-c860-4994-a5be-6aa83a7ec9d8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:45.866879 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8db4b1e7-c860-4994-a5be-6aa83a7ec9d8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:45.875252 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8db4b1e7-c860-4994-a5be-6aa83a7ec9d8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:45.875252 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8db4b1e7-c860-4994-a5be-6aa83a7ec9d8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:45.875252 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8db4b1e7-c860-4994-a5be-6aa83a7ec9d8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:45.875252 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8db4b1e7-c860-4994-a5be-6aa83a7ec9d8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:45.876085 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8db4b1e7-c860-4994-a5be-6aa83a7ec9d8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:45.876085 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8db4b1e7-c860-4994-a5be-6aa83a7ec9d8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:46.009341 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8db4b1e7-c860-4994-a5be-6aa83a7ec9d8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:46.017600 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8db4b1e7-c860-4994-a5be-6aa83a7ec9d8 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1719 microversion: 2.1 time: 0.155195 Aug 24 17:02:46.018332 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 557/1116] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:45 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:46.757351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f5d1e14f-ccd8-43a8-b9b9-4596c834d5e4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:46.757973 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f5d1e14f-ccd8-43a8-b9b9-4596c834d5e4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:46.765408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5d1e14f-ccd8-43a8-b9b9-4596c834d5e4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:46.765897 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5d1e14f-ccd8-43a8-b9b9-4596c834d5e4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:46.766338 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5d1e14f-ccd8-43a8-b9b9-4596c834d5e4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:46.767033 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5d1e14f-ccd8-43a8-b9b9-4596c834d5e4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:46.767495 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5d1e14f-ccd8-43a8-b9b9-4596c834d5e4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:46.767923 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5d1e14f-ccd8-43a8-b9b9-4596c834d5e4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:46.827364 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f5d1e14f-ccd8-43a8-b9b9-4596c834d5e4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:46.834926 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f5d1e14f-ccd8-43a8-b9b9-4596c834d5e4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1144 microversion: 2.1 time: 0.081775 Aug 24 17:02:46.835494 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 560/1117] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:46 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:47.039224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-85feec56-82ee-48b5-8c19-d51b9cdd6159 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:47.039845 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-85feec56-82ee-48b5-8c19-d51b9cdd6159 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:47.047046 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85feec56-82ee-48b5-8c19-d51b9cdd6159 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:47.047532 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85feec56-82ee-48b5-8c19-d51b9cdd6159 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:47.047973 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85feec56-82ee-48b5-8c19-d51b9cdd6159 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:47.048706 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85feec56-82ee-48b5-8c19-d51b9cdd6159 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:47.049174 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85feec56-82ee-48b5-8c19-d51b9cdd6159 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:47.049603 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-85feec56-82ee-48b5-8c19-d51b9cdd6159 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:47.175160 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-85feec56-82ee-48b5-8c19-d51b9cdd6159 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:47.183365 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-85feec56-82ee-48b5-8c19-d51b9cdd6159 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1719 microversion: 2.1 time: 0.148084 Aug 24 17:02:47.183928 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 558/1118] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:47 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:02:47.855148 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-55439ff6-2f3a-48d5-a92a-06d2ebe0ce2a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:47.855766 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-55439ff6-2f3a-48d5-a92a-06d2ebe0ce2a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:47.862839 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55439ff6-2f3a-48d5-a92a-06d2ebe0ce2a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:47.863318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55439ff6-2f3a-48d5-a92a-06d2ebe0ce2a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:47.863754 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55439ff6-2f3a-48d5-a92a-06d2ebe0ce2a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:47.864504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55439ff6-2f3a-48d5-a92a-06d2ebe0ce2a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:47.864960 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55439ff6-2f3a-48d5-a92a-06d2ebe0ce2a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:47.865385 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55439ff6-2f3a-48d5-a92a-06d2ebe0ce2a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:47.931580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-55439ff6-2f3a-48d5-a92a-06d2ebe0ce2a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:47.939597 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-55439ff6-2f3a-48d5-a92a-06d2ebe0ce2a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1136 microversion: 2.1 time: 0.088405 Aug 24 17:02:47.940235 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 561/1119] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:47 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1136 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:48.205364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-f8e9bbd8-a2d2-4468-acb8-31b816200183 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:48.206556 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-f8e9bbd8-a2d2-4468-acb8-31b816200183 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:48.213294 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8e9bbd8-a2d2-4468-acb8-31b816200183 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:48.217448 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8e9bbd8-a2d2-4468-acb8-31b816200183 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:48.217448 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8e9bbd8-a2d2-4468-acb8-31b816200183 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:48.217448 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8e9bbd8-a2d2-4468-acb8-31b816200183 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:48.217448 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8e9bbd8-a2d2-4468-acb8-31b816200183 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:48.217898 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-f8e9bbd8-a2d2-4468-acb8-31b816200183 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:48.342510 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-f8e9bbd8-a2d2-4468-acb8-31b816200183 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:48.350724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-f8e9bbd8-a2d2-4468-acb8-31b816200183 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1719 microversion: 2.1 time: 0.149736 Aug 24 17:02:48.351282 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 559/1120] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:48 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:48.960501 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-08802050-d179-4fae-8d79-373c24f05951 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:48.961122 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-08802050-d179-4fae-8d79-373c24f05951 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:48.967497 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08802050-d179-4fae-8d79-373c24f05951 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:48.967978 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08802050-d179-4fae-8d79-373c24f05951 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:48.968438 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08802050-d179-4fae-8d79-373c24f05951 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:48.969132 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08802050-d179-4fae-8d79-373c24f05951 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:48.969584 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08802050-d179-4fae-8d79-373c24f05951 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:48.970006 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08802050-d179-4fae-8d79-373c24f05951 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:49.031803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-08802050-d179-4fae-8d79-373c24f05951 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:49.039415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-08802050-d179-4fae-8d79-373c24f05951 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1210 microversion: 2.1 time: 0.082865 Aug 24 17:02:49.040007 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 562/1121] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:48 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:02:49.371871 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4af5fdf4-d7f9-46f6-9180-9e4df81d3d30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:49.372798 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4af5fdf4-d7f9-46f6-9180-9e4df81d3d30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:49.381282 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4af5fdf4-d7f9-46f6-9180-9e4df81d3d30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:49.386060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4af5fdf4-d7f9-46f6-9180-9e4df81d3d30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:49.386060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4af5fdf4-d7f9-46f6-9180-9e4df81d3d30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:49.386060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4af5fdf4-d7f9-46f6-9180-9e4df81d3d30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:49.386060 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4af5fdf4-d7f9-46f6-9180-9e4df81d3d30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:49.386502 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4af5fdf4-d7f9-46f6-9180-9e4df81d3d30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:49.534421 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4af5fdf4-d7f9-46f6-9180-9e4df81d3d30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:49.547435 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4af5fdf4-d7f9-46f6-9180-9e4df81d3d30 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1719 microversion: 2.1 time: 0.179885 Aug 24 17:02:49.548086 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 560/1122] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:49 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:50.064830 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e37d5940-1155-4774-95e4-76242ca2793e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:50.065453 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e37d5940-1155-4774-95e4-76242ca2793e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:50.071944 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e37d5940-1155-4774-95e4-76242ca2793e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:50.072537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e37d5940-1155-4774-95e4-76242ca2793e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:50.072981 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e37d5940-1155-4774-95e4-76242ca2793e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:50.073678 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e37d5940-1155-4774-95e4-76242ca2793e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:50.074140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e37d5940-1155-4774-95e4-76242ca2793e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:50.074616 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e37d5940-1155-4774-95e4-76242ca2793e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:50.110947 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-c89a49e4-4308-488e-9c57-e4ee73416a93 req-d7aa7586-e9c2-4339-9342-c63f0b4cd96b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9708889-6063-4e38-91b9-0df38ddb6bd6", "tag": "f9ebb137-ae7c-4c7a-ad72-43d58a464bc1"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:02:50.121446 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-c89a49e4-4308-488e-9c57-e4ee73416a93 req-d7aa7586-e9c2-4339-9342-c63f0b4cd96b service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:50.121696 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-c89a49e4-4308-488e-9c57-e4ee73416a93 req-d7aa7586-e9c2-4339-9342-c63f0b4cd96b service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:50.121992 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-c89a49e4-4308-488e-9c57-e4ee73416a93 req-d7aa7586-e9c2-4339-9342-c63f0b4cd96b service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:50.134306 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-c89a49e4-4308-488e-9c57-e4ee73416a93 req-d7aa7586-e9c2-4339-9342-c63f0b4cd96b service nova] Creating event network-changed:f9ebb137-ae7c-4c7a-ad72-43d58a464bc1 for instance a9708889-6063-4e38-91b9-0df38ddb6bd6 on hv-cinder-85220 Aug 24 17:02:50.139950 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-c89a49e4-4308-488e-9c57-e4ee73416a93 req-d7aa7586-e9c2-4339-9342-c63f0b4cd96b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032628 Aug 24 17:02:50.141123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 561/1123] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:02:50.220547 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e37d5940-1155-4774-95e4-76242ca2793e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:50.236253 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e37d5940-1155-4774-95e4-76242ca2793e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1265 microversion: 2.1 time: 0.175681 Aug 24 17:02:50.237470 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 563/1124] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:50 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:50.571436 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-4f8ca8a0-1fd5-4951-8dc8-7b64794f0350 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:50.572144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-4f8ca8a0-1fd5-4951-8dc8-7b64794f0350 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:50.578274 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4f8ca8a0-1fd5-4951-8dc8-7b64794f0350 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:50.578759 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4f8ca8a0-1fd5-4951-8dc8-7b64794f0350 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:50.579195 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4f8ca8a0-1fd5-4951-8dc8-7b64794f0350 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:50.579921 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4f8ca8a0-1fd5-4951-8dc8-7b64794f0350 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:50.580426 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4f8ca8a0-1fd5-4951-8dc8-7b64794f0350 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:50.580977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-4f8ca8a0-1fd5-4951-8dc8-7b64794f0350 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:50.707640 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-4f8ca8a0-1fd5-4951-8dc8-7b64794f0350 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:50.716262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-4f8ca8a0-1fd5-4951-8dc8-7b64794f0350 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1719 microversion: 2.1 time: 0.149813 Aug 24 17:02:50.717375 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 562/1125] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:50 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:51.258234 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-29fa840a-45b2-4783-a9b3-4e330c0e1666 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:51.258851 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-29fa840a-45b2-4783-a9b3-4e330c0e1666 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:51.266003 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29fa840a-45b2-4783-a9b3-4e330c0e1666 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:51.266484 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29fa840a-45b2-4783-a9b3-4e330c0e1666 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:51.266917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29fa840a-45b2-4783-a9b3-4e330c0e1666 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:51.267605 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29fa840a-45b2-4783-a9b3-4e330c0e1666 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:51.268056 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29fa840a-45b2-4783-a9b3-4e330c0e1666 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:51.268503 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29fa840a-45b2-4783-a9b3-4e330c0e1666 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:51.398969 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-29fa840a-45b2-4783-a9b3-4e330c0e1666 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:51.406736 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-29fa840a-45b2-4783-a9b3-4e330c0e1666 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1265 microversion: 2.1 time: 0.152689 Aug 24 17:02:51.407300 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 564/1126] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:51 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:51.738570 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ac997aef-79d2-4fe9-8bed-8ca78434ff18 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:51.739187 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ac997aef-79d2-4fe9-8bed-8ca78434ff18 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:51.745769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ac997aef-79d2-4fe9-8bed-8ca78434ff18 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:51.746252 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ac997aef-79d2-4fe9-8bed-8ca78434ff18 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:51.746692 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ac997aef-79d2-4fe9-8bed-8ca78434ff18 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:51.747381 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ac997aef-79d2-4fe9-8bed-8ca78434ff18 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:51.747836 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ac997aef-79d2-4fe9-8bed-8ca78434ff18 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:51.748944 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ac997aef-79d2-4fe9-8bed-8ca78434ff18 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:51.876599 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ac997aef-79d2-4fe9-8bed-8ca78434ff18 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:51.884946 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ac997aef-79d2-4fe9-8bed-8ca78434ff18 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1719 microversion: 2.1 time: 0.150323 Aug 24 17:02:51.885507 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 563/1127] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:51 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:52.426949 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7ade7379-f902-4fe9-a738-fc1560294cb4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:52.427548 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7ade7379-f902-4fe9-a738-fc1560294cb4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:52.433928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ade7379-f902-4fe9-a738-fc1560294cb4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:52.434402 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ade7379-f902-4fe9-a738-fc1560294cb4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:52.434839 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ade7379-f902-4fe9-a738-fc1560294cb4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:52.435515 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ade7379-f902-4fe9-a738-fc1560294cb4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:52.435960 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ade7379-f902-4fe9-a738-fc1560294cb4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:52.436376 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ade7379-f902-4fe9-a738-fc1560294cb4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:52.567928 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7ade7379-f902-4fe9-a738-fc1560294cb4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:52.575712 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7ade7379-f902-4fe9-a738-fc1560294cb4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1265 microversion: 2.1 time: 0.152622 Aug 24 17:02:52.576854 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 565/1128] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:52 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:52.905546 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-da8916b9-6cf3-4d9b-a2d8-8ca0b7f4266c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:52.906157 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-da8916b9-6cf3-4d9b-a2d8-8ca0b7f4266c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:52.912556 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-da8916b9-6cf3-4d9b-a2d8-8ca0b7f4266c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:52.913038 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-da8916b9-6cf3-4d9b-a2d8-8ca0b7f4266c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:52.913481 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-da8916b9-6cf3-4d9b-a2d8-8ca0b7f4266c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:52.914148 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-da8916b9-6cf3-4d9b-a2d8-8ca0b7f4266c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:52.914598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-da8916b9-6cf3-4d9b-a2d8-8ca0b7f4266c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:52.915015 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-da8916b9-6cf3-4d9b-a2d8-8ca0b7f4266c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:53.041900 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-da8916b9-6cf3-4d9b-a2d8-8ca0b7f4266c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:53.050679 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-da8916b9-6cf3-4d9b-a2d8-8ca0b7f4266c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1696 microversion: 2.1 time: 0.149462 Aug 24 17:02:53.051665 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 564/1129] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:52 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1696 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:53.073033 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ccc6dbd0-4508-4e7f-b8ad-fd478d72490c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:02:53.078938 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ccc6dbd0-4508-4e7f-b8ad-fd478d72490c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:53.079414 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ccc6dbd0-4508-4e7f-b8ad-fd478d72490c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:53.079841 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ccc6dbd0-4508-4e7f-b8ad-fd478d72490c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:53.097841 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:53.103976 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ccc6dbd0-4508-4e7f-b8ad-fd478d72490c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Going to try to start instance {{(pid=127716) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 17:02:53.274304 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ccc6dbd0-4508-4e7f-b8ad-fd478d72490c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "POST /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/action" status: 202 len: 0 microversion: 2.1 time: 0.204780 Aug 24 17:02:53.274822 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 566/1130] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 17:02:53 2022] POST /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:02:53.283314 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ad0700bf-52df-4a7b-be4f-17d85945eec3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:53.283922 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ad0700bf-52df-4a7b-be4f-17d85945eec3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:53.291605 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad0700bf-52df-4a7b-be4f-17d85945eec3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:53.292145 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad0700bf-52df-4a7b-be4f-17d85945eec3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:53.292632 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad0700bf-52df-4a7b-be4f-17d85945eec3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:53.293346 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad0700bf-52df-4a7b-be4f-17d85945eec3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:53.293807 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad0700bf-52df-4a7b-be4f-17d85945eec3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:53.294242 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad0700bf-52df-4a7b-be4f-17d85945eec3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:53.431246 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ad0700bf-52df-4a7b-be4f-17d85945eec3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:53.439453 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ad0700bf-52df-4a7b-be4f-17d85945eec3 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1705 microversion: 2.1 time: 0.160446 Aug 24 17:02:53.440024 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 565/1131] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:53 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1705 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:53.598447 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-04591d23-6513-4d2f-953f-3698bd424dcb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:53.599154 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-04591d23-6513-4d2f-953f-3698bd424dcb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:53.605397 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04591d23-6513-4d2f-953f-3698bd424dcb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:53.605877 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04591d23-6513-4d2f-953f-3698bd424dcb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:53.606317 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04591d23-6513-4d2f-953f-3698bd424dcb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:53.607012 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04591d23-6513-4d2f-953f-3698bd424dcb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:53.607505 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04591d23-6513-4d2f-953f-3698bd424dcb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:53.607931 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04591d23-6513-4d2f-953f-3698bd424dcb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:53.751495 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-04591d23-6513-4d2f-953f-3698bd424dcb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:53.759891 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-04591d23-6513-4d2f-953f-3698bd424dcb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1265 microversion: 2.1 time: 0.166356 Aug 24 17:02:53.760529 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 567/1132] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:53 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:54.461664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fcee81f9-31b6-4baa-bb72-a5043b4e8b14 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:54.462226 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fcee81f9-31b6-4baa-bb72-a5043b4e8b14 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:54.468683 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcee81f9-31b6-4baa-bb72-a5043b4e8b14 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:54.469165 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcee81f9-31b6-4baa-bb72-a5043b4e8b14 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:54.469598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcee81f9-31b6-4baa-bb72-a5043b4e8b14 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:54.470291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcee81f9-31b6-4baa-bb72-a5043b4e8b14 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:54.470748 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcee81f9-31b6-4baa-bb72-a5043b4e8b14 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:54.471172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fcee81f9-31b6-4baa-bb72-a5043b4e8b14 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:54.475272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:54.603013 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fcee81f9-31b6-4baa-bb72-a5043b4e8b14 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:54.611355 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fcee81f9-31b6-4baa-bb72-a5043b4e8b14 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1705 microversion: 2.1 time: 0.153616 Aug 24 17:02:54.611964 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 566/1133] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:54 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1705 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:54.780242 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-af0c95ba-bbf3-45e2-a456-87e832159c79 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:54.780824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-af0c95ba-bbf3-45e2-a456-87e832159c79 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:54.787085 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af0c95ba-bbf3-45e2-a456-87e832159c79 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:54.787561 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af0c95ba-bbf3-45e2-a456-87e832159c79 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:54.787988 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af0c95ba-bbf3-45e2-a456-87e832159c79 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:54.788701 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af0c95ba-bbf3-45e2-a456-87e832159c79 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:54.789154 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af0c95ba-bbf3-45e2-a456-87e832159c79 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:54.789574 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af0c95ba-bbf3-45e2-a456-87e832159c79 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:54.926092 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-af0c95ba-bbf3-45e2-a456-87e832159c79 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:54.933770 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-af0c95ba-bbf3-45e2-a456-87e832159c79 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1265 microversion: 2.1 time: 0.157423 Aug 24 17:02:54.934345 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 568/1134] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:54 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:55.633144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-36111945-52e7-4a3d-8b8a-29ca726ecf07 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:55.633761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-36111945-52e7-4a3d-8b8a-29ca726ecf07 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:55.635674 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:55.636339 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=6 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:55.641530 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36111945-52e7-4a3d-8b8a-29ca726ecf07 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:55.642012 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36111945-52e7-4a3d-8b8a-29ca726ecf07 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:55.642447 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36111945-52e7-4a3d-8b8a-29ca726ecf07 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:55.643133 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36111945-52e7-4a3d-8b8a-29ca726ecf07 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:55.643591 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36111945-52e7-4a3d-8b8a-29ca726ecf07 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:55.650070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-36111945-52e7-4a3d-8b8a-29ca726ecf07 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:55.877845 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-36111945-52e7-4a3d-8b8a-29ca726ecf07 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:55.886267 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-36111945-52e7-4a3d-8b8a-29ca726ecf07 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1709 microversion: 2.1 time: 0.257231 Aug 24 17:02:55.886837 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 567/1135] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:55 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1709 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:55.956083 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b8b50b0e-b75a-4d2c-877b-194cbf013422 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:55.956721 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b8b50b0e-b75a-4d2c-877b-194cbf013422 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:55.958817 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:55.964113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8b50b0e-b75a-4d2c-877b-194cbf013422 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:55.970415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8b50b0e-b75a-4d2c-877b-194cbf013422 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:55.970415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8b50b0e-b75a-4d2c-877b-194cbf013422 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:55.970415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8b50b0e-b75a-4d2c-877b-194cbf013422 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:55.970415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8b50b0e-b75a-4d2c-877b-194cbf013422 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:55.970810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8b50b0e-b75a-4d2c-877b-194cbf013422 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:56.099050 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b8b50b0e-b75a-4d2c-877b-194cbf013422 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:56.106973 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b8b50b0e-b75a-4d2c-877b-194cbf013422 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1265 microversion: 2.1 time: 0.154780 Aug 24 17:02:56.107528 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 569/1136] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:55 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:57.127739 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-470c3a1d-b991-4925-b2fb-560d834ae7ae tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:57.128330 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-470c3a1d-b991-4925-b2fb-560d834ae7ae tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:57.134989 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-470c3a1d-b991-4925-b2fb-560d834ae7ae tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:57.135466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-470c3a1d-b991-4925-b2fb-560d834ae7ae tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:57.135900 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-470c3a1d-b991-4925-b2fb-560d834ae7ae tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:57.136637 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-470c3a1d-b991-4925-b2fb-560d834ae7ae tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:57.137076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-470c3a1d-b991-4925-b2fb-560d834ae7ae tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:57.137534 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-470c3a1d-b991-4925-b2fb-560d834ae7ae tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:57.264230 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-470c3a1d-b991-4925-b2fb-560d834ae7ae tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:57.272311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-470c3a1d-b991-4925-b2fb-560d834ae7ae tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1265 microversion: 2.1 time: 0.148434 Aug 24 17:02:57.272910 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 568/1137] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:57 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:58.294082 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4a7bd5f1-c1e9-48c8-9073-c616d487b49f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:58.294701 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4a7bd5f1-c1e9-48c8-9073-c616d487b49f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:58.300544 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a7bd5f1-c1e9-48c8-9073-c616d487b49f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:58.301021 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a7bd5f1-c1e9-48c8-9073-c616d487b49f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:58.301451 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a7bd5f1-c1e9-48c8-9073-c616d487b49f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:58.302129 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a7bd5f1-c1e9-48c8-9073-c616d487b49f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:58.302573 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a7bd5f1-c1e9-48c8-9073-c616d487b49f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:58.302990 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a7bd5f1-c1e9-48c8-9073-c616d487b49f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:58.481070 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4a7bd5f1-c1e9-48c8-9073-c616d487b49f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:58.494594 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4a7bd5f1-c1e9-48c8-9073-c616d487b49f tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1265 microversion: 2.1 time: 0.204836 Aug 24 17:02:58.495175 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 570/1138] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:58 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:02:59.516577 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-45fde621-49c2-4bf2-b3ae-0d33d7a99196 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:02:59.517197 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-45fde621-49c2-4bf2-b3ae-0d33d7a99196 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:02:59.523598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-45fde621-49c2-4bf2-b3ae-0d33d7a99196 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:59.524086 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-45fde621-49c2-4bf2-b3ae-0d33d7a99196 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:59.524564 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-45fde621-49c2-4bf2-b3ae-0d33d7a99196 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:59.525260 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-45fde621-49c2-4bf2-b3ae-0d33d7a99196 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:02:59.525720 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-45fde621-49c2-4bf2-b3ae-0d33d7a99196 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:02:59.526159 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-45fde621-49c2-4bf2-b3ae-0d33d7a99196 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:02:59.663933 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-45fde621-49c2-4bf2-b3ae-0d33d7a99196 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:02:59.671655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-45fde621-49c2-4bf2-b3ae-0d33d7a99196 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1265 microversion: 2.1 time: 0.159558 Aug 24 17:02:59.672212 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 569/1139] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:02:59 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:00.691075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7e5509d7-8cec-4ca5-9743-bf96551b93ab tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:00.691682 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7e5509d7-8cec-4ca5-9743-bf96551b93ab tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:00.698140 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e5509d7-8cec-4ca5-9743-bf96551b93ab tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:00.698622 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e5509d7-8cec-4ca5-9743-bf96551b93ab tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:00.699049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e5509d7-8cec-4ca5-9743-bf96551b93ab tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:00.699727 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e5509d7-8cec-4ca5-9743-bf96551b93ab tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:00.700170 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e5509d7-8cec-4ca5-9743-bf96551b93ab tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:00.701112 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e5509d7-8cec-4ca5-9743-bf96551b93ab tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:00.826595 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7e5509d7-8cec-4ca5-9743-bf96551b93ab tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:00.834174 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7e5509d7-8cec-4ca5-9743-bf96551b93ab tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1265 microversion: 2.1 time: 0.146955 Aug 24 17:03:00.834725 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 571/1140] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:00 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:01.549287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-a305f88e-26e8-4e63-94a4-ac1094ccb55f req-b31a1255-660c-43ae-91dd-b53f0aeb5413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9708889-6063-4e38-91b9-0df38ddb6bd6", "name": "network-vif-plugged", "status": "completed", "tag": "f9ebb137-ae7c-4c7a-ad72-43d58a464bc1"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:03:01.563169 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-a305f88e-26e8-4e63-94a4-ac1094ccb55f req-b31a1255-660c-43ae-91dd-b53f0aeb5413 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:01.563666 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-a305f88e-26e8-4e63-94a4-ac1094ccb55f req-b31a1255-660c-43ae-91dd-b53f0aeb5413 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:01.564225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-a305f88e-26e8-4e63-94a4-ac1094ccb55f req-b31a1255-660c-43ae-91dd-b53f0aeb5413 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:01.577938 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-a305f88e-26e8-4e63-94a4-ac1094ccb55f req-b31a1255-660c-43ae-91dd-b53f0aeb5413 service nova] Creating event network-vif-plugged:f9ebb137-ae7c-4c7a-ad72-43d58a464bc1 for instance a9708889-6063-4e38-91b9-0df38ddb6bd6 on hv-cinder-85220 Aug 24 17:03:01.582829 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-a305f88e-26e8-4e63-94a4-ac1094ccb55f req-b31a1255-660c-43ae-91dd-b53f0aeb5413 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037917 Aug 24 17:03:01.583417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 570/1141] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:03:01.854837 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e0444bcb-abc1-4567-a42d-c34440060849 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:01.855459 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e0444bcb-abc1-4567-a42d-c34440060849 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:01.858522 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=47 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:01.863217 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e0444bcb-abc1-4567-a42d-c34440060849 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:01.863704 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e0444bcb-abc1-4567-a42d-c34440060849 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:01.864142 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e0444bcb-abc1-4567-a42d-c34440060849 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:01.864874 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e0444bcb-abc1-4567-a42d-c34440060849 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:01.865331 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e0444bcb-abc1-4567-a42d-c34440060849 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:01.865759 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e0444bcb-abc1-4567-a42d-c34440060849 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:01.998621 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e0444bcb-abc1-4567-a42d-c34440060849 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:02.006777 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e0444bcb-abc1-4567-a42d-c34440060849 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1265 microversion: 2.1 time: 0.155733 Aug 24 17:03:02.007367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 572/1142] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:01 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:03.028381 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ec67de9d-3736-4a41-98e1-e34e135c6a23 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:03.029105 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ec67de9d-3736-4a41-98e1-e34e135c6a23 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:03.035765 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec67de9d-3736-4a41-98e1-e34e135c6a23 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:03.036248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec67de9d-3736-4a41-98e1-e34e135c6a23 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:03.036720 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec67de9d-3736-4a41-98e1-e34e135c6a23 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:03.037413 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec67de9d-3736-4a41-98e1-e34e135c6a23 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:03.037869 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec67de9d-3736-4a41-98e1-e34e135c6a23 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:03.038295 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ec67de9d-3736-4a41-98e1-e34e135c6a23 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:03.167865 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ec67de9d-3736-4a41-98e1-e34e135c6a23 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:03.175489 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ec67de9d-3736-4a41-98e1-e34e135c6a23 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1265 microversion: 2.1 time: 0.151781 Aug 24 17:03:03.176059 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 571/1143] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:03 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:04.195086 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5c18e08a-b6c6-4592-a480-e832e316eab6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:04.195638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5c18e08a-b6c6-4592-a480-e832e316eab6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:04.201952 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5c18e08a-b6c6-4592-a480-e832e316eab6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:04.202425 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5c18e08a-b6c6-4592-a480-e832e316eab6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:04.202857 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5c18e08a-b6c6-4592-a480-e832e316eab6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:04.203531 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5c18e08a-b6c6-4592-a480-e832e316eab6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:04.203985 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5c18e08a-b6c6-4592-a480-e832e316eab6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:04.204418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5c18e08a-b6c6-4592-a480-e832e316eab6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:04.333517 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5c18e08a-b6c6-4592-a480-e832e316eab6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:04.341049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5c18e08a-b6c6-4592-a480-e832e316eab6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1452 microversion: 2.1 time: 0.149887 Aug 24 17:03:04.341604 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 573/1144] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:04 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:04.361390 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-46a7a5cc-99a8-4d68-981f-e788edbdc9a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:04.362001 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-46a7a5cc-99a8-4d68-981f-e788edbdc9a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:04.368374 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-46a7a5cc-99a8-4d68-981f-e788edbdc9a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:04.368914 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-46a7a5cc-99a8-4d68-981f-e788edbdc9a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:04.369350 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-46a7a5cc-99a8-4d68-981f-e788edbdc9a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:04.370039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-46a7a5cc-99a8-4d68-981f-e788edbdc9a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:04.370488 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-46a7a5cc-99a8-4d68-981f-e788edbdc9a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:04.370912 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-46a7a5cc-99a8-4d68-981f-e788edbdc9a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:04.496724 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-46a7a5cc-99a8-4d68-981f-e788edbdc9a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:04.504261 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-46a7a5cc-99a8-4d68-981f-e788edbdc9a4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1452 microversion: 2.1 time: 0.147270 Aug 24 17:03:04.505115 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 572/1145] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:04 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:06.662274 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-bcfbffd1-de0a-4122-a2fa-1bb19578d7fa req-f0fe854b-1df4-41cd-826c-f21cd58c819f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9708889-6063-4e38-91b9-0df38ddb6bd6", "tag": "f9ebb137-ae7c-4c7a-ad72-43d58a464bc1"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:03:06.672651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-bcfbffd1-de0a-4122-a2fa-1bb19578d7fa req-f0fe854b-1df4-41cd-826c-f21cd58c819f service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:06.673126 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-bcfbffd1-de0a-4122-a2fa-1bb19578d7fa req-f0fe854b-1df4-41cd-826c-f21cd58c819f service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:06.673612 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-bcfbffd1-de0a-4122-a2fa-1bb19578d7fa req-f0fe854b-1df4-41cd-826c-f21cd58c819f service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:06.684473 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-bcfbffd1-de0a-4122-a2fa-1bb19578d7fa req-f0fe854b-1df4-41cd-826c-f21cd58c819f service nova] Creating event network-changed:f9ebb137-ae7c-4c7a-ad72-43d58a464bc1 for instance a9708889-6063-4e38-91b9-0df38ddb6bd6 on hv-cinder-85220 Aug 24 17:03:06.689585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-bcfbffd1-de0a-4122-a2fa-1bb19578d7fa req-f0fe854b-1df4-41cd-826c-f21cd58c819f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030959 Aug 24 17:03:06.690406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 574/1146] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:03:08.733463 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:03:08.734058 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Wed Aug 24 17:03:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:03:14.875206 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:03:14.875768 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Wed Aug 24 17:03:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:03:18.892849 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-04edb07d-65d2-471d-ace9-d087da40b875 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:03:18.895058 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-04edb07d-65d2-471d-ace9-d087da40b875 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:18.897528 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:18.898193 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=36 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:18.903539 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-04edb07d-65d2-471d-ace9-d087da40b875 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:18.904022 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-04edb07d-65d2-471d-ace9-d087da40b875 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:18.905078 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-04edb07d-65d2-471d-ace9-d087da40b875 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:18.905802 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-04edb07d-65d2-471d-ace9-d087da40b875 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:18.906253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-04edb07d-65d2-471d-ace9-d087da40b875 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:18.906676 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-04edb07d-65d2-471d-ace9-d087da40b875 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:19.102902 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-04edb07d-65d2-471d-ace9-d087da40b875 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "POST /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/action" status: 202 len: 0 microversion: 2.1 time: 0.214333 Aug 24 17:03:19.103699 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 573/1147] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 17:03:18 2022] POST /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:03:19.112828 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d0eccff2-cd9a-40fc-9540-6a70f0008ad8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:19.113530 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d0eccff2-cd9a-40fc-9540-6a70f0008ad8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:19.116071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=5 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:19.116753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:19.121743 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0eccff2-cd9a-40fc-9540-6a70f0008ad8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:19.122220 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0eccff2-cd9a-40fc-9540-6a70f0008ad8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:19.122650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0eccff2-cd9a-40fc-9540-6a70f0008ad8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:19.123862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0eccff2-cd9a-40fc-9540-6a70f0008ad8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:19.124307 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0eccff2-cd9a-40fc-9540-6a70f0008ad8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:19.124794 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0eccff2-cd9a-40fc-9540-6a70f0008ad8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:19.273172 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d0eccff2-cd9a-40fc-9540-6a70f0008ad8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:19.281402 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d0eccff2-cd9a-40fc-9540-6a70f0008ad8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1750 microversion: 2.1 time: 0.173517 Aug 24 17:03:19.281972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 575/1148] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:19 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:20.302597 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fd8b7d10-40a7-49a9-95f6-4fadabaa1b01 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:20.303290 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fd8b7d10-40a7-49a9-95f6-4fadabaa1b01 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:20.309821 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd8b7d10-40a7-49a9-95f6-4fadabaa1b01 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:20.310295 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd8b7d10-40a7-49a9-95f6-4fadabaa1b01 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:20.311339 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd8b7d10-40a7-49a9-95f6-4fadabaa1b01 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:20.312023 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd8b7d10-40a7-49a9-95f6-4fadabaa1b01 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:20.312510 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd8b7d10-40a7-49a9-95f6-4fadabaa1b01 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:20.312932 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fd8b7d10-40a7-49a9-95f6-4fadabaa1b01 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:20.452193 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-fd8b7d10-40a7-49a9-95f6-4fadabaa1b01 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:20.460324 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fd8b7d10-40a7-49a9-95f6-4fadabaa1b01 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1755 microversion: 2.1 time: 0.162041 Aug 24 17:03:20.460905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 574/1149] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:20 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:21.484666 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-04cb7b61-d625-4c24-81e2-86a0668ed436 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:21.485316 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-04cb7b61-d625-4c24-81e2-86a0668ed436 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:21.491752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04cb7b61-d625-4c24-81e2-86a0668ed436 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:21.492232 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04cb7b61-d625-4c24-81e2-86a0668ed436 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:21.492699 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04cb7b61-d625-4c24-81e2-86a0668ed436 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:21.493392 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04cb7b61-d625-4c24-81e2-86a0668ed436 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:21.493880 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04cb7b61-d625-4c24-81e2-86a0668ed436 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:21.494307 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-04cb7b61-d625-4c24-81e2-86a0668ed436 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:21.640020 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-04cb7b61-d625-4c24-81e2-86a0668ed436 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:21.648173 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-04cb7b61-d625-4c24-81e2-86a0668ed436 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1755 microversion: 2.1 time: 0.167470 Aug 24 17:03:21.648798 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 576/1150] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:21 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:22.669196 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8f29fc10-8c97-4d14-ae79-4f757a0f0aaf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:22.669809 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8f29fc10-8c97-4d14-ae79-4f757a0f0aaf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:22.676125 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f29fc10-8c97-4d14-ae79-4f757a0f0aaf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:22.676649 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f29fc10-8c97-4d14-ae79-4f757a0f0aaf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:22.677092 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f29fc10-8c97-4d14-ae79-4f757a0f0aaf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:22.677820 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f29fc10-8c97-4d14-ae79-4f757a0f0aaf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:22.678279 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f29fc10-8c97-4d14-ae79-4f757a0f0aaf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:22.678703 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8f29fc10-8c97-4d14-ae79-4f757a0f0aaf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:22.818197 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8f29fc10-8c97-4d14-ae79-4f757a0f0aaf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:22.826887 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8f29fc10-8c97-4d14-ae79-4f757a0f0aaf tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1755 microversion: 2.1 time: 0.160929 Aug 24 17:03:22.827446 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 575/1151] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:22 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:23.847250 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-598e1f06-9a14-4793-a9ac-aaea965ef36b tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:23.847787 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-598e1f06-9a14-4793-a9ac-aaea965ef36b tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:23.854168 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-598e1f06-9a14-4793-a9ac-aaea965ef36b tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:23.854646 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-598e1f06-9a14-4793-a9ac-aaea965ef36b tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:23.855083 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-598e1f06-9a14-4793-a9ac-aaea965ef36b tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:23.855766 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-598e1f06-9a14-4793-a9ac-aaea965ef36b tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:23.856220 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-598e1f06-9a14-4793-a9ac-aaea965ef36b tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:23.856668 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-598e1f06-9a14-4793-a9ac-aaea965ef36b tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:24.002817 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-598e1f06-9a14-4793-a9ac-aaea965ef36b tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:24.011250 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-598e1f06-9a14-4793-a9ac-aaea965ef36b tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1755 microversion: 2.1 time: 0.168070 Aug 24 17:03:24.011820 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 577/1152] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:23 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:25.032267 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b9855f3d-aae0-4aed-987e-6064bc72ef95 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:25.032933 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b9855f3d-aae0-4aed-987e-6064bc72ef95 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:25.039216 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b9855f3d-aae0-4aed-987e-6064bc72ef95 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:25.039691 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b9855f3d-aae0-4aed-987e-6064bc72ef95 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:25.040123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b9855f3d-aae0-4aed-987e-6064bc72ef95 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:25.040840 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b9855f3d-aae0-4aed-987e-6064bc72ef95 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:25.041288 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b9855f3d-aae0-4aed-987e-6064bc72ef95 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:25.041709 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b9855f3d-aae0-4aed-987e-6064bc72ef95 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:25.184201 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b9855f3d-aae0-4aed-987e-6064bc72ef95 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:25.192874 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b9855f3d-aae0-4aed-987e-6064bc72ef95 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1755 microversion: 2.1 time: 0.164479 Aug 24 17:03:25.193442 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 576/1153] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:25 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:26.214639 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a57bbf52-c2b7-4a7b-ac85-760ee9727fa7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:26.215178 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a57bbf52-c2b7-4a7b-ac85-760ee9727fa7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:26.222143 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a57bbf52-c2b7-4a7b-ac85-760ee9727fa7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:26.222615 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a57bbf52-c2b7-4a7b-ac85-760ee9727fa7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:26.223047 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a57bbf52-c2b7-4a7b-ac85-760ee9727fa7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:26.223729 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a57bbf52-c2b7-4a7b-ac85-760ee9727fa7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:26.224180 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a57bbf52-c2b7-4a7b-ac85-760ee9727fa7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:26.224628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a57bbf52-c2b7-4a7b-ac85-760ee9727fa7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:26.362653 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a57bbf52-c2b7-4a7b-ac85-760ee9727fa7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:26.370733 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a57bbf52-c2b7-4a7b-ac85-760ee9727fa7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1755 microversion: 2.1 time: 0.160044 Aug 24 17:03:26.371297 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 578/1154] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:26 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:27.391592 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c69f5ab1-b9cc-4f0e-82ea-c12b480d67f9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:27.392185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-c69f5ab1-b9cc-4f0e-82ea-c12b480d67f9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:27.398589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c69f5ab1-b9cc-4f0e-82ea-c12b480d67f9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:27.399070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c69f5ab1-b9cc-4f0e-82ea-c12b480d67f9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:27.399502 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c69f5ab1-b9cc-4f0e-82ea-c12b480d67f9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:27.400189 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c69f5ab1-b9cc-4f0e-82ea-c12b480d67f9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:27.400671 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c69f5ab1-b9cc-4f0e-82ea-c12b480d67f9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:27.401095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-c69f5ab1-b9cc-4f0e-82ea-c12b480d67f9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:27.541435 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-c69f5ab1-b9cc-4f0e-82ea-c12b480d67f9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:27.550295 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c69f5ab1-b9cc-4f0e-82ea-c12b480d67f9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1755 microversion: 2.1 time: 0.162588 Aug 24 17:03:27.550855 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 577/1155] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:27 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:28.571143 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d7c223f3-860a-4660-b4a4-b5c80e70d027 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:28.571753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d7c223f3-860a-4660-b4a4-b5c80e70d027 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:28.577883 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7c223f3-860a-4660-b4a4-b5c80e70d027 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:28.578355 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7c223f3-860a-4660-b4a4-b5c80e70d027 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:28.578784 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7c223f3-860a-4660-b4a4-b5c80e70d027 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:28.579464 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7c223f3-860a-4660-b4a4-b5c80e70d027 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:28.579920 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7c223f3-860a-4660-b4a4-b5c80e70d027 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:28.580326 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7c223f3-860a-4660-b4a4-b5c80e70d027 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:28.719859 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d7c223f3-860a-4660-b4a4-b5c80e70d027 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:28.728001 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d7c223f3-860a-4660-b4a4-b5c80e70d027 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1755 microversion: 2.1 time: 0.160854 Aug 24 17:03:28.728591 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 579/1156] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:28 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:29.749776 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-65900b8d-1bb6-437d-9489-949dc4775f7f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:29.750385 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-65900b8d-1bb6-437d-9489-949dc4775f7f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:29.757083 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65900b8d-1bb6-437d-9489-949dc4775f7f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:29.757560 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65900b8d-1bb6-437d-9489-949dc4775f7f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:29.757989 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65900b8d-1bb6-437d-9489-949dc4775f7f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:29.758668 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65900b8d-1bb6-437d-9489-949dc4775f7f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:29.759120 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65900b8d-1bb6-437d-9489-949dc4775f7f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:29.759534 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-65900b8d-1bb6-437d-9489-949dc4775f7f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:29.911125 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-65900b8d-1bb6-437d-9489-949dc4775f7f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:29.919928 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-65900b8d-1bb6-437d-9489-949dc4775f7f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1755 microversion: 2.1 time: 0.174006 Aug 24 17:03:29.920552 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 578/1157] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:29 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:30.940915 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e1f89af3-34c7-4544-bc3d-7c7b406fd0b0 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:30.941525 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e1f89af3-34c7-4544-bc3d-7c7b406fd0b0 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:30.948020 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1f89af3-34c7-4544-bc3d-7c7b406fd0b0 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:30.948531 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1f89af3-34c7-4544-bc3d-7c7b406fd0b0 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:30.948950 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1f89af3-34c7-4544-bc3d-7c7b406fd0b0 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:30.949627 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1f89af3-34c7-4544-bc3d-7c7b406fd0b0 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:30.950071 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1f89af3-34c7-4544-bc3d-7c7b406fd0b0 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:30.950998 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1f89af3-34c7-4544-bc3d-7c7b406fd0b0 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:31.089157 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e1f89af3-34c7-4544-bc3d-7c7b406fd0b0 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:03:31.097192 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e1f89af3-34c7-4544-bc3d-7c7b406fd0b0 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1758 microversion: 2.1 time: 0.160192 Aug 24 17:03:31.097757 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 580/1158] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:03:30 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:03:59.361870 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-029f93b0-c085-4223-97d8-8ae572f4d0c1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:03:59.362481 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-029f93b0-c085-4223-97d8-8ae572f4d0c1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:03:59.364627 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=12 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:59.365302 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:59.369968 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-029f93b0-c085-4223-97d8-8ae572f4d0c1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:59.374004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-029f93b0-c085-4223-97d8-8ae572f4d0c1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:59.374004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-029f93b0-c085-4223-97d8-8ae572f4d0c1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:59.374004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-029f93b0-c085-4223-97d8-8ae572f4d0c1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:03:59.374004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-029f93b0-c085-4223-97d8-8ae572f4d0c1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:03:59.374436 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-029f93b0-c085-4223-97d8-8ae572f4d0c1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:03:59.452170 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-029f93b0-c085-4223-97d8-8ae572f4d0c1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lazy-loading 'services' on Instance uuid 4f799b07-9fb4-4890-841d-d4621c0a6980 {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:03:59.685812 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-029f93b0-c085-4223-97d8-8ae572f4d0c1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/os-volume_attachments/86f31d35-bde4-4f8d-80f6-6bd25b0e253c" status: 202 len: 0 microversion: 2.1 time: 0.327592 Aug 24 17:03:59.686346 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 579/1159] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Aug 24 17:03:59 2022] DELETE /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/os-volume_attachments/86f31d35-bde4-4f8d-80f6-6bd25b0e253c => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:04:00.804555 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0bd2baed-7a0d-4e62-b609-dda6d3a9da26 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:04:00.806799 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=12 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:00.807459 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=36 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:00.812650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0bd2baed-7a0d-4e62-b609-dda6d3a9da26 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:00.813138 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0bd2baed-7a0d-4e62-b609-dda6d3a9da26 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:00.813578 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0bd2baed-7a0d-4e62-b609-dda6d3a9da26 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:00.836152 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0bd2baed-7a0d-4e62-b609-dda6d3a9da26 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Going to try to stop instance {{(pid=127716) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 17:04:00.964474 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0bd2baed-7a0d-4e62-b609-dda6d3a9da26 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "POST /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/action" status: 202 len: 0 microversion: 2.1 time: 0.163684 Aug 24 17:04:00.965047 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 581/1160] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 17:04:00 2022] POST /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:04:00.973752 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9b2f6c29-4bdf-4537-8aa4-838f415ff6af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:00.974445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9b2f6c29-4bdf-4537-8aa4-838f415ff6af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:00.981009 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9b2f6c29-4bdf-4537-8aa4-838f415ff6af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:00.981504 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9b2f6c29-4bdf-4537-8aa4-838f415ff6af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:00.981938 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9b2f6c29-4bdf-4537-8aa4-838f415ff6af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:00.982622 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9b2f6c29-4bdf-4537-8aa4-838f415ff6af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:00.983073 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9b2f6c29-4bdf-4537-8aa4-838f415ff6af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:00.983493 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9b2f6c29-4bdf-4537-8aa4-838f415ff6af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:01.111786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9b2f6c29-4bdf-4537-8aa4-838f415ff6af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:01.119751 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9b2f6c29-4bdf-4537-8aa4-838f415ff6af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1673 microversion: 2.1 time: 0.150149 Aug 24 17:04:01.120323 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 580/1161] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:00 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:04:02.142826 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3e0eda83-2879-4224-900a-57e1e3b6c0e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:02.143530 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3e0eda83-2879-4224-900a-57e1e3b6c0e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:02.149676 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e0eda83-2879-4224-900a-57e1e3b6c0e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:02.150160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e0eda83-2879-4224-900a-57e1e3b6c0e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:02.150598 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e0eda83-2879-4224-900a-57e1e3b6c0e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:02.151287 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e0eda83-2879-4224-900a-57e1e3b6c0e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:02.151768 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e0eda83-2879-4224-900a-57e1e3b6c0e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:02.152190 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e0eda83-2879-4224-900a-57e1e3b6c0e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:02.283250 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3e0eda83-2879-4224-900a-57e1e3b6c0e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:02.290847 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3e0eda83-2879-4224-900a-57e1e3b6c0e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1673 microversion: 2.1 time: 0.152873 Aug 24 17:04:02.291415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 582/1162] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:02 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:04:03.312615 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1ff61169-700e-4c89-aa0a-35f71da3b5cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:03.313232 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1ff61169-700e-4c89-aa0a-35f71da3b5cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:03.319631 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1ff61169-700e-4c89-aa0a-35f71da3b5cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:03.320095 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1ff61169-700e-4c89-aa0a-35f71da3b5cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:03.320558 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1ff61169-700e-4c89-aa0a-35f71da3b5cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:03.321291 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1ff61169-700e-4c89-aa0a-35f71da3b5cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:03.321751 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1ff61169-700e-4c89-aa0a-35f71da3b5cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:03.322173 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1ff61169-700e-4c89-aa0a-35f71da3b5cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:03.446908 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1ff61169-700e-4c89-aa0a-35f71da3b5cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:03.454989 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1ff61169-700e-4c89-aa0a-35f71da3b5cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1673 microversion: 2.1 time: 0.146375 Aug 24 17:04:03.455556 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 581/1163] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:03 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:04:04.476694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4e5a438d-7a5d-4051-b151-5001136079b9 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:04.477350 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4e5a438d-7a5d-4051-b151-5001136079b9 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:04.484423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e5a438d-7a5d-4051-b151-5001136079b9 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:04.484921 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e5a438d-7a5d-4051-b151-5001136079b9 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:04.485355 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e5a438d-7a5d-4051-b151-5001136079b9 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:04.486045 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e5a438d-7a5d-4051-b151-5001136079b9 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:04.486496 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e5a438d-7a5d-4051-b151-5001136079b9 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:04.486919 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e5a438d-7a5d-4051-b151-5001136079b9 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:04.615707 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4e5a438d-7a5d-4051-b151-5001136079b9 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:04.623279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4e5a438d-7a5d-4051-b151-5001136079b9 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1673 microversion: 2.1 time: 0.150418 Aug 24 17:04:04.623848 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 583/1164] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:04 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:04:05.643650 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0d2209da-a5fa-4b99-8abd-f6a77f5e6ee7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:05.644251 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0d2209da-a5fa-4b99-8abd-f6a77f5e6ee7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:05.650884 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d2209da-a5fa-4b99-8abd-f6a77f5e6ee7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:05.651368 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d2209da-a5fa-4b99-8abd-f6a77f5e6ee7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:05.651807 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d2209da-a5fa-4b99-8abd-f6a77f5e6ee7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:05.652554 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d2209da-a5fa-4b99-8abd-f6a77f5e6ee7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:05.653042 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d2209da-a5fa-4b99-8abd-f6a77f5e6ee7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:05.653594 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d2209da-a5fa-4b99-8abd-f6a77f5e6ee7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:05.795868 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-0d2209da-a5fa-4b99-8abd-f6a77f5e6ee7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:05.803647 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0d2209da-a5fa-4b99-8abd-f6a77f5e6ee7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1673 microversion: 2.1 time: 0.163939 Aug 24 17:04:05.804214 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 582/1165] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:05 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:04:06.824621 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5a03784f-ce6b-4d01-96e3-c141a4c9a689 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:06.825239 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5a03784f-ce6b-4d01-96e3-c141a4c9a689 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:06.831594 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a03784f-ce6b-4d01-96e3-c141a4c9a689 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:06.832075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a03784f-ce6b-4d01-96e3-c141a4c9a689 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:06.832552 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a03784f-ce6b-4d01-96e3-c141a4c9a689 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:06.833244 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a03784f-ce6b-4d01-96e3-c141a4c9a689 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:06.833696 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a03784f-ce6b-4d01-96e3-c141a4c9a689 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:06.834115 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a03784f-ce6b-4d01-96e3-c141a4c9a689 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:06.962440 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5a03784f-ce6b-4d01-96e3-c141a4c9a689 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:06.970605 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5a03784f-ce6b-4d01-96e3-c141a4c9a689 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1673 microversion: 2.1 time: 0.149865 Aug 24 17:04:06.971169 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 584/1166] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:06 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:04:07.991389 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ea21960a-354d-4d08-bea2-e1c7fdf20b4b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:07.992005 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ea21960a-354d-4d08-bea2-e1c7fdf20b4b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:08.000708 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ea21960a-354d-4d08-bea2-e1c7fdf20b4b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:08.001196 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ea21960a-354d-4d08-bea2-e1c7fdf20b4b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:08.002076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ea21960a-354d-4d08-bea2-e1c7fdf20b4b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:08.002327 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ea21960a-354d-4d08-bea2-e1c7fdf20b4b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:08.002782 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ea21960a-354d-4d08-bea2-e1c7fdf20b4b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:08.003207 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ea21960a-354d-4d08-bea2-e1c7fdf20b4b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:08.131237 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ea21960a-354d-4d08-bea2-e1c7fdf20b4b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:08.139592 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ea21960a-354d-4d08-bea2-e1c7fdf20b4b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1673 microversion: 2.1 time: 0.152106 Aug 24 17:04:08.140159 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 583/1167] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:07 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:04:09.162001 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-31f6b04a-d0dc-4c8c-ab5a-2a665bbbd506 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:09.162597 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-31f6b04a-d0dc-4c8c-ab5a-2a665bbbd506 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:09.168971 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f6b04a-d0dc-4c8c-ab5a-2a665bbbd506 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:09.169448 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f6b04a-d0dc-4c8c-ab5a-2a665bbbd506 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:09.169875 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f6b04a-d0dc-4c8c-ab5a-2a665bbbd506 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:09.170553 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f6b04a-d0dc-4c8c-ab5a-2a665bbbd506 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:09.170997 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f6b04a-d0dc-4c8c-ab5a-2a665bbbd506 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:09.171414 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f6b04a-d0dc-4c8c-ab5a-2a665bbbd506 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:09.297865 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-31f6b04a-d0dc-4c8c-ab5a-2a665bbbd506 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:09.305390 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-31f6b04a-d0dc-4c8c-ab5a-2a665bbbd506 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1673 microversion: 2.1 time: 0.147319 Aug 24 17:04:09.305952 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 585/1168] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:09 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:04:10.326774 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a6445226-5739-4211-9405-21759221985a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:10.327383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a6445226-5739-4211-9405-21759221985a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:10.333980 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a6445226-5739-4211-9405-21759221985a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:10.334464 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a6445226-5739-4211-9405-21759221985a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:10.334901 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a6445226-5739-4211-9405-21759221985a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:10.335588 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a6445226-5739-4211-9405-21759221985a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:10.336044 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a6445226-5739-4211-9405-21759221985a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:10.336565 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a6445226-5739-4211-9405-21759221985a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:10.465226 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-a6445226-5739-4211-9405-21759221985a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:10.472979 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a6445226-5739-4211-9405-21759221985a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1673 microversion: 2.1 time: 0.150117 Aug 24 17:04:10.473556 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 584/1169] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:10 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:04:11.494147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ad84fc03-2ea8-4407-a4a6-eb65d11ffbe7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:11.494758 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ad84fc03-2ea8-4407-a4a6-eb65d11ffbe7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:11.501196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad84fc03-2ea8-4407-a4a6-eb65d11ffbe7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:11.501671 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad84fc03-2ea8-4407-a4a6-eb65d11ffbe7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:11.502094 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad84fc03-2ea8-4407-a4a6-eb65d11ffbe7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:11.502774 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad84fc03-2ea8-4407-a4a6-eb65d11ffbe7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:11.503220 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad84fc03-2ea8-4407-a4a6-eb65d11ffbe7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:11.503636 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad84fc03-2ea8-4407-a4a6-eb65d11ffbe7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:11.628903 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ad84fc03-2ea8-4407-a4a6-eb65d11ffbe7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:11.637551 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ad84fc03-2ea8-4407-a4a6-eb65d11ffbe7 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1650 microversion: 2.1 time: 0.146816 Aug 24 17:04:11.638116 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 586/1170] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:11 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1650 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:04:11.658131 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-de4b5aec-85fd-42d5-ab2a-8dd56b3fa32a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:04:11.664655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-de4b5aec-85fd-42d5-ab2a-8dd56b3fa32a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:11.665144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-de4b5aec-85fd-42d5-ab2a-8dd56b3fa32a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:11.665577 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-de4b5aec-85fd-42d5-ab2a-8dd56b3fa32a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:11.724222 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-de4b5aec-85fd-42d5-ab2a-8dd56b3fa32a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Going to try to start instance {{(pid=127715) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 17:04:11.974713 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-de4b5aec-85fd-42d5-ab2a-8dd56b3fa32a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "POST /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/action" status: 202 len: 0 microversion: 2.1 time: 0.320233 Aug 24 17:04:11.975319 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 585/1171] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 17:04:11 2022] POST /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:04:11.983592 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cfaeb9ac-00fc-4f3f-b889-6d9f114b80d1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:11.984196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cfaeb9ac-00fc-4f3f-b889-6d9f114b80d1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:11.990128 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfaeb9ac-00fc-4f3f-b889-6d9f114b80d1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:11.990813 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfaeb9ac-00fc-4f3f-b889-6d9f114b80d1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:11.991244 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfaeb9ac-00fc-4f3f-b889-6d9f114b80d1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:11.991980 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfaeb9ac-00fc-4f3f-b889-6d9f114b80d1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:11.992445 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfaeb9ac-00fc-4f3f-b889-6d9f114b80d1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:11.992870 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfaeb9ac-00fc-4f3f-b889-6d9f114b80d1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:12.126072 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cfaeb9ac-00fc-4f3f-b889-6d9f114b80d1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:12.134155 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cfaeb9ac-00fc-4f3f-b889-6d9f114b80d1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1659 microversion: 2.1 time: 0.154433 Aug 24 17:04:12.134725 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 587/1172] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:11 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1659 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:04:13.156760 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-be2fcbce-fa12-45f6-8daf-eb871916a83e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:13.157462 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-be2fcbce-fa12-45f6-8daf-eb871916a83e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:13.163485 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be2fcbce-fa12-45f6-8daf-eb871916a83e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:13.163966 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be2fcbce-fa12-45f6-8daf-eb871916a83e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:13.164456 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be2fcbce-fa12-45f6-8daf-eb871916a83e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:13.165151 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be2fcbce-fa12-45f6-8daf-eb871916a83e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:13.165604 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be2fcbce-fa12-45f6-8daf-eb871916a83e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:13.166027 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-be2fcbce-fa12-45f6-8daf-eb871916a83e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:13.295021 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-be2fcbce-fa12-45f6-8daf-eb871916a83e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:13.302590 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-be2fcbce-fa12-45f6-8daf-eb871916a83e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1659 microversion: 2.1 time: 0.151217 Aug 24 17:04:13.303155 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 586/1173] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:13 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1659 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:04:14.323174 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-91ba1f78-b62c-4617-b08e-406ed1e8febe tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:14.323765 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-91ba1f78-b62c-4617-b08e-406ed1e8febe tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:14.330145 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91ba1f78-b62c-4617-b08e-406ed1e8febe tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:14.330619 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91ba1f78-b62c-4617-b08e-406ed1e8febe tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:14.331048 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91ba1f78-b62c-4617-b08e-406ed1e8febe tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:14.331757 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91ba1f78-b62c-4617-b08e-406ed1e8febe tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:14.332202 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91ba1f78-b62c-4617-b08e-406ed1e8febe tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:14.332650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91ba1f78-b62c-4617-b08e-406ed1e8febe tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:14.460882 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-91ba1f78-b62c-4617-b08e-406ed1e8febe tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:14.468959 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-91ba1f78-b62c-4617-b08e-406ed1e8febe tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1663 microversion: 2.1 time: 0.149698 Aug 24 17:04:14.469524 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 588/1174] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:14 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:04:37.040631 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-95678859-801e-4306-a5b9-df7de3c70268 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-223832531"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:04:37.041289 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-95678859-801e-4306-a5b9-df7de3c70268 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:37.043270 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=16 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:37.043922 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:37.049267 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-95678859-801e-4306-a5b9-df7de3c70268 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:37.052351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-95678859-801e-4306-a5b9-df7de3c70268 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:37.052351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-95678859-801e-4306-a5b9-df7de3c70268 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:37.052351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-95678859-801e-4306-a5b9-df7de3c70268 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:37.052351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-95678859-801e-4306-a5b9-df7de3c70268 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:37.052777 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-95678859-801e-4306-a5b9-df7de3c70268 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:37.180253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.network.security_group_api [None req-95678859-801e-4306-a5b9-df7de3c70268 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Removing security group ce0b190a-50e1-4ae9-9bbf-6d35787ed3d5 from port 36e5522b-8ad1-4469-99a6-9ee02971e5ff Aug 24 17:04:37.520552 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-95678859-801e-4306-a5b9-df7de3c70268 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "POST /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/action" status: 202 len: 0 microversion: 2.1 time: 0.484411 Aug 24 17:04:37.521173 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 587/1175] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Aug 24 17:04:37 2022] POST /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:04:37.533936 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-170097b3-9532-44a8-9a40-1bdf6948edb1 req-979ebf4a-ddb5-4493-b0bd-a579ad6460f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9129ed01-364e-4c0b-ad15-040bdaaaec13", "tag": "36e5522b-8ad1-4469-99a6-9ee02971e5ff"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:04:37.548231 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=16 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:37.563244 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:37.563244 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-170097b3-9532-44a8-9a40-1bdf6948edb1 req-979ebf4a-ddb5-4493-b0bd-a579ad6460f6 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:37.563244 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-170097b3-9532-44a8-9a40-1bdf6948edb1 req-979ebf4a-ddb5-4493-b0bd-a579ad6460f6 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:37.563244 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-170097b3-9532-44a8-9a40-1bdf6948edb1 req-979ebf4a-ddb5-4493-b0bd-a579ad6460f6 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:37.579263 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-170097b3-9532-44a8-9a40-1bdf6948edb1 req-979ebf4a-ddb5-4493-b0bd-a579ad6460f6 service nova] Creating event network-changed:36e5522b-8ad1-4469-99a6-9ee02971e5ff for instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 on hv-cinder-85220 Aug 24 17:04:37.585474 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-170097b3-9532-44a8-9a40-1bdf6948edb1 req-979ebf4a-ddb5-4493-b0bd-a579ad6460f6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059384 Aug 24 17:04:37.585887 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 589/1176] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:04:38.762487 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9c007b64-5530-4b30-a14a-a369baa806e7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:38.762994 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9c007b64-5530-4b30-a14a-a369baa806e7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:38.769749 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9c007b64-5530-4b30-a14a-a369baa806e7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:38.770227 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9c007b64-5530-4b30-a14a-a369baa806e7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:38.770659 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9c007b64-5530-4b30-a14a-a369baa806e7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:38.771336 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9c007b64-5530-4b30-a14a-a369baa806e7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:38.771786 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9c007b64-5530-4b30-a14a-a369baa806e7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:38.772202 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9c007b64-5530-4b30-a14a-a369baa806e7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:38.855132 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-9c007b64-5530-4b30-a14a-a369baa806e7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lazy-loading 'services' on Instance uuid 9129ed01-364e-4c0b-ad15-040bdaaaec13 {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:04:39.027376 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9c007b64-5530-4b30-a14a-a369baa806e7 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/os-volume_attachments/2e31b17a-f3b7-4f46-ac98-6b16238c3d00" status: 202 len: 0 microversion: 2.1 time: 0.269097 Aug 24 17:04:39.028280 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 588/1177] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Aug 24 17:04:38 2022] DELETE /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/os-volume_attachments/2e31b17a-f3b7-4f46-ac98-6b16238c3d00 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:04:39.037227 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2967c8f3-56d0-4321-83dc-6284a304df47 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:39.039490 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2967c8f3-56d0-4321-83dc-6284a304df47 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:39.047862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2967c8f3-56d0-4321-83dc-6284a304df47 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:39.048350 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2967c8f3-56d0-4321-83dc-6284a304df47 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:39.049010 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2967c8f3-56d0-4321-83dc-6284a304df47 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:39.049718 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2967c8f3-56d0-4321-83dc-6284a304df47 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:39.050172 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2967c8f3-56d0-4321-83dc-6284a304df47 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:39.050593 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2967c8f3-56d0-4321-83dc-6284a304df47 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:39.081428 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2967c8f3-56d0-4321-83dc-6284a304df47 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048898 Aug 24 17:04:39.082016 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 590/1178] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 17:04:39 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:04:39.602486 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-1f4ed9a8-8e2c-4b7c-92de-0f60202eff64 req-6663e738-1adf-4912-9b4d-7f234644e336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9129ed01-364e-4c0b-ad15-040bdaaaec13", "tag": "36e5522b-8ad1-4469-99a6-9ee02971e5ff"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:04:39.614862 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-1f4ed9a8-8e2c-4b7c-92de-0f60202eff64 req-6663e738-1adf-4912-9b4d-7f234644e336 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:39.615350 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-1f4ed9a8-8e2c-4b7c-92de-0f60202eff64 req-6663e738-1adf-4912-9b4d-7f234644e336 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:39.615783 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-1f4ed9a8-8e2c-4b7c-92de-0f60202eff64 req-6663e738-1adf-4912-9b4d-7f234644e336 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:39.627960 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-1f4ed9a8-8e2c-4b7c-92de-0f60202eff64 req-6663e738-1adf-4912-9b4d-7f234644e336 service nova] Creating event network-changed:36e5522b-8ad1-4469-99a6-9ee02971e5ff for instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 on hv-cinder-85220 Aug 24 17:04:39.633037 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-1f4ed9a8-8e2c-4b7c-92de-0f60202eff64 req-6663e738-1adf-4912-9b4d-7f234644e336 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035467 Aug 24 17:04:39.633870 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 589/1179] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:04:40.093993 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b544818f-a200-4dea-a35d-f0d2ed8a5793 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:40.096537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b544818f-a200-4dea-a35d-f0d2ed8a5793 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:40.103728 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b544818f-a200-4dea-a35d-f0d2ed8a5793 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:40.104278 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b544818f-a200-4dea-a35d-f0d2ed8a5793 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:40.107620 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b544818f-a200-4dea-a35d-f0d2ed8a5793 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:40.107620 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b544818f-a200-4dea-a35d-f0d2ed8a5793 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:40.107620 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b544818f-a200-4dea-a35d-f0d2ed8a5793 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:40.107620 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b544818f-a200-4dea-a35d-f0d2ed8a5793 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:40.135867 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b544818f-a200-4dea-a35d-f0d2ed8a5793 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045928 Aug 24 17:04:40.136963 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 591/1180] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 17:04:40 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:04:40.148996 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2ea5e02e-6581-4e1c-92aa-f7c40956bdde tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:40.149603 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2ea5e02e-6581-4e1c-92aa-f7c40956bdde tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:40.155952 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2ea5e02e-6581-4e1c-92aa-f7c40956bdde tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:40.156379 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2ea5e02e-6581-4e1c-92aa-f7c40956bdde tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:40.156912 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2ea5e02e-6581-4e1c-92aa-f7c40956bdde tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:40.157578 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2ea5e02e-6581-4e1c-92aa-f7c40956bdde tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:40.158031 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2ea5e02e-6581-4e1c-92aa-f7c40956bdde tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:40.158455 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2ea5e02e-6581-4e1c-92aa-f7c40956bdde tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:40.233346 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-2ea5e02e-6581-4e1c-92aa-f7c40956bdde tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] HTTP exception thrown: Instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 is not attached to volume 2e31b17a-f3b7-4f46-ac98-6b16238c3d00 Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2ea5e02e-6581-4e1c-92aa-f7c40956bdde tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Request method failure captured: Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: DELETE /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/os-volume_attachments/2e31b17a-f3b7-4f46-ac98-6b16238c3d00 HTTP/1.1 Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBllRwvtf66UH4RtnV78qESvK83HIQec2t5pGsrBhmpVJkYoMAt5nCw_gx1jHD0_67cMk_XeWZcwxzK50EFvJKp_Qcztg31nvujbia1mmi3TXVuN4hPb1vCCO0sE4wwZ7Igs06ise8S4k8sJeJxxyfoRbHl0cAbeShrFzVqFWrzUCB_4 Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 6d4ca39653d24886b79e5e7175e7b4cc Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-TestMinimumBasicScenario-377928866 Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 17:04:40.235643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 17:04:40.237569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6d4ca39653d24886b79e5e7175e7b4cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6d4ca39653d24886b79e5e7175e7b4cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6d4ca39653d24886b79e5e7175e7b4cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6d4ca39653d24886b79e5e7175e7b4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:04:40.237569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-TestMinimumBasicScenario-377928866 Aug 24 17:04:40.237569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 6d4ca39653d24886b79e5e7175e7b4cc Aug 24 17:04:40.237569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-TestMinimumBasicScenario-377928866 Aug 24 17:04:40.237569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-TestMinimumBasicScenario-377928866-project Aug 24 17:04:40.237569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 17:04:40.237569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 17:04:40.237569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 4bdcfac8e4bf4b589d3958be4fd032f2 Aug 24 17:04:40.237569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-TestMinimumBasicScenario-377928866-project Aug 24 17:04:40.237569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 17:04:40.237569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 is not attached to volume 2e31b17a-f3b7-4f46-ac98-6b16238c3d00 Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'server_id': '9129ed01-364e-4c0b-ad15-040bdaaaec13', 'id': '2e31b17a-f3b7-4f46-ac98-6b16238c3d00'} Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2e31b17a-f3b7-4f46-ac98-6b16238c3d00. Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:04:40.238651 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 is not attached to volume 2e31b17a-f3b7-4f46-ac98-6b16238c3d00 Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 is not attached to volume 2e31b17a-f3b7-4f46-ac98-6b16238c3d00 Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:04:40.240241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2ea5e02e-6581-4e1c-92aa-f7c40956bdde tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Returning 404 to user: Instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 is not attached to volume 2e31b17a-f3b7-4f46-ac98-6b16238c3d00 {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:04:40.241602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2ea5e02e-6581-4e1c-92aa-f7c40956bdde tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/os-volume_attachments/2e31b17a-f3b7-4f46-ac98-6b16238c3d00" status: 404 len: 154 microversion: 2.1 time: 0.092937 Aug 24 17:04:40.241602 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 590/1181] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Aug 24 17:04:40 2022] DELETE /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13/os-volume_attachments/2e31b17a-f3b7-4f46-ac98-6b16238c3d00 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:04:41.483729 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7018db59-a5f4-45fc-b824-4cbd4cb438c8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:41.484226 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7018db59-a5f4-45fc-b824-4cbd4cb438c8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:41.490808 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7018db59-a5f4-45fc-b824-4cbd4cb438c8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:41.491292 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7018db59-a5f4-45fc-b824-4cbd4cb438c8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:41.491731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7018db59-a5f4-45fc-b824-4cbd4cb438c8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:41.492442 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7018db59-a5f4-45fc-b824-4cbd4cb438c8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:41.492902 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7018db59-a5f4-45fc-b824-4cbd4cb438c8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:41.493329 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7018db59-a5f4-45fc-b824-4cbd4cb438c8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:41.517553 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7018db59-a5f4-45fc-b824-4cbd4cb438c8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:04:41.787992 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7018db59-a5f4-45fc-b824-4cbd4cb438c8 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 204 len: 0 microversion: 2.1 time: 0.308798 Aug 24 17:04:41.788605 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 592/1182] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 17:04:41 2022] DELETE /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:04:41.797783 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-05919a6f-ad4f-45f7-849f-176f1ecfec4a tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:41.798897 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-05919a6f-ad4f-45f7-849f-176f1ecfec4a tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:41.805566 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05919a6f-ad4f-45f7-849f-176f1ecfec4a tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:41.806044 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05919a6f-ad4f-45f7-849f-176f1ecfec4a tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:41.806475 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05919a6f-ad4f-45f7-849f-176f1ecfec4a tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:41.807167 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05919a6f-ad4f-45f7-849f-176f1ecfec4a tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:41.807620 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05919a6f-ad4f-45f7-849f-176f1ecfec4a tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:41.808043 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-05919a6f-ad4f-45f7-849f-176f1ecfec4a tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:41.951969 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-05919a6f-ad4f-45f7-849f-176f1ecfec4a tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:41.959863 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-05919a6f-ad4f-45f7-849f-176f1ecfec4a tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1554 microversion: 2.1 time: 0.166811 Aug 24 17:04:41.960438 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 591/1183] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:41 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:04:42.982097 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d5503e46-bf59-41e1-bf4c-5a83de8aa93f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:42.982756 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d5503e46-bf59-41e1-bf4c-5a83de8aa93f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:42.989149 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5503e46-bf59-41e1-bf4c-5a83de8aa93f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:42.989635 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5503e46-bf59-41e1-bf4c-5a83de8aa93f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:42.990058 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5503e46-bf59-41e1-bf4c-5a83de8aa93f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:42.990742 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5503e46-bf59-41e1-bf4c-5a83de8aa93f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:42.991193 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5503e46-bf59-41e1-bf4c-5a83de8aa93f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:42.991612 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5503e46-bf59-41e1-bf4c-5a83de8aa93f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:43.121911 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5503e46-bf59-41e1-bf4c-5a83de8aa93f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:43.130359 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d5503e46-bf59-41e1-bf4c-5a83de8aa93f tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1554 microversion: 2.1 time: 0.152544 Aug 24 17:04:43.130937 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 593/1184] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:42 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:04:44.151800 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-1b8fe9fe-c100-4a8c-9f31-7f54858f3de9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:44.152435 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-1b8fe9fe-c100-4a8c-9f31-7f54858f3de9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:44.158925 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1b8fe9fe-c100-4a8c-9f31-7f54858f3de9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:44.159411 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1b8fe9fe-c100-4a8c-9f31-7f54858f3de9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:44.159845 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1b8fe9fe-c100-4a8c-9f31-7f54858f3de9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:44.160561 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1b8fe9fe-c100-4a8c-9f31-7f54858f3de9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:44.161017 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1b8fe9fe-c100-4a8c-9f31-7f54858f3de9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:44.161446 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-1b8fe9fe-c100-4a8c-9f31-7f54858f3de9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:44.287961 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-1b8fe9fe-c100-4a8c-9f31-7f54858f3de9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:44.296212 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-1b8fe9fe-c100-4a8c-9f31-7f54858f3de9 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1554 microversion: 2.1 time: 0.147729 Aug 24 17:04:44.296810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 592/1185] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:44 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:04:44.485816 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-ec053743-aa02-4dff-95a5-fd557b65973d req-ef3ba88e-59b8-4fb6-b036-3a04b7a26460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9129ed01-364e-4c0b-ad15-040bdaaaec13", "name": "network-vif-deleted", "tag": "36e5522b-8ad1-4469-99a6-9ee02971e5ff"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:04:44.496054 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-ec053743-aa02-4dff-95a5-fd557b65973d req-ef3ba88e-59b8-4fb6-b036-3a04b7a26460 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:44.497935 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-ec053743-aa02-4dff-95a5-fd557b65973d req-ef3ba88e-59b8-4fb6-b036-3a04b7a26460 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:44.497935 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-ec053743-aa02-4dff-95a5-fd557b65973d req-ef3ba88e-59b8-4fb6-b036-3a04b7a26460 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:44.508751 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-ec053743-aa02-4dff-95a5-fd557b65973d req-ef3ba88e-59b8-4fb6-b036-3a04b7a26460 service nova] Creating event network-vif-deleted:36e5522b-8ad1-4469-99a6-9ee02971e5ff for instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 on hv-cinder-85220 Aug 24 17:04:44.513546 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-ec053743-aa02-4dff-95a5-fd557b65973d req-ef3ba88e-59b8-4fb6-b036-3a04b7a26460 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031577 Aug 24 17:04:44.514706 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 594/1186] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:04:45.317344 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:45.318012 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:45.324440 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:45.328421 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:45.328421 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:45.328421 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:45.328421 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:45.328826 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:45.359156 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:45.359677 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:45.360141 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:45.360619 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.objects.instance [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lazy-loading 'fault' on Instance uuid 9129ed01-364e-4c0b-ad15-040bdaaaec13 {{(pid=127715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:04:45.401444 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdcfac8e4bf4b589d3958be4fd032f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ca39653d24886b79e5e7175e7b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:04:45.408498 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-58081227-3441-4a15-8244-6bd8d80b3287 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 200 len: 1348 microversion: 2.1 time: 0.095290 Aug 24 17:04:45.408997 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 593/1187] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:45 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:04:46.430351 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-014e9dfa-0ce5-4478-bf9f-35e3b7b28723 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:46.431049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-014e9dfa-0ce5-4478-bf9f-35e3b7b28723 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] [instance: 9129ed01-364e-4c0b-ad15-040bdaaaec13] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:04:46.437249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-014e9dfa-0ce5-4478-bf9f-35e3b7b28723 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:46.437729 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-014e9dfa-0ce5-4478-bf9f-35e3b7b28723 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:46.438166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-014e9dfa-0ce5-4478-bf9f-35e3b7b28723 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:46.438856 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-014e9dfa-0ce5-4478-bf9f-35e3b7b28723 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:04:46.439305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-014e9dfa-0ce5-4478-bf9f-35e3b7b28723 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:04:46.439729 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-014e9dfa-0ce5-4478-bf9f-35e3b7b28723 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:04:46.453600 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-014e9dfa-0ce5-4478-bf9f-35e3b7b28723 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] HTTP exception thrown: Instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 could not be found. Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-014e9dfa-0ce5-4478-bf9f-35e3b7b28723 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Request method failure captured: Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 HTTP/1.1 Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBllRwvtf66UH4RtnV78qESvK83HIQec2t5pGsrBhmpVJkYoMAt5nCw_gx1jHD0_67cMk_XeWZcwxzK50EFvJKp_Qcztg31nvujbia1mmi3TXVuN4hPb1vCCO0sE4wwZ7Igs06ise8S4k8sJeJxxyfoRbHl0cAbeShrFzVqFWrzUCB_4 Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 6d4ca39653d24886b79e5e7175e7b4cc Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-TestMinimumBasicScenario-377928866 Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 17:04:46.455196 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 17:04:46.456868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6d4ca39653d24886b79e5e7175e7b4cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6d4ca39653d24886b79e5e7175e7b4cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6d4ca39653d24886b79e5e7175e7b4cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6d4ca39653d24886b79e5e7175e7b4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:04:46.456868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-TestMinimumBasicScenario-377928866 Aug 24 17:04:46.456868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 6d4ca39653d24886b79e5e7175e7b4cc Aug 24 17:04:46.456868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-TestMinimumBasicScenario-377928866 Aug 24 17:04:46.456868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-TestMinimumBasicScenario-377928866-project Aug 24 17:04:46.456868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 17:04:46.456868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 17:04:46.456868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 4bdcfac8e4bf4b589d3958be4fd032f2 Aug 24 17:04:46.456868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-TestMinimumBasicScenario-377928866-project Aug 24 17:04:46.456868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 17:04:46.456868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 could not be found. Aug 24 17:04:46.456868 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '9129ed01-364e-4c0b-ad15-040bdaaaec13'} Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 could not be found. Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:04:46.457835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 could not be found. Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 could not be found. Aug 24 17:04:46.459541 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:04:46.461089 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-014e9dfa-0ce5-4478-bf9f-35e3b7b28723 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Returning 404 to user: Instance 9129ed01-364e-4c0b-ad15-040bdaaaec13 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:04:46.461089 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-014e9dfa-0ce5-4478-bf9f-35e3b7b28723 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13" status: 404 len: 111 microversion: 2.1 time: 0.030899 Aug 24 17:04:46.461089 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 595/1188] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:04:46 2022] GET /compute/v2.1/servers/9129ed01-364e-4c0b-ad15-040bdaaaec13 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:04:46.466444 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e519caf6-0f0a-40cb-8a5a-fb538ab77487 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] Calling method '.version_select at 0x7fa195440550>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:04:46.578752 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e519caf6-0f0a-40cb-8a5a-fb538ab77487 tempest-TestMinimumBasicScenario-377928866 tempest-TestMinimumBasicScenario-377928866-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1255832466" status: 202 len: 0 microversion: 2.1 time: 0.116035 Aug 24 17:04:46.579331 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 594/1189] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Aug 24 17:04:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1255832466 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:05:18.465424 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e068977a-143a-4a6a-87f8-c48ac1415feb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:18.467540 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e068977a-143a-4a6a-87f8-c48ac1415feb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:18.469697 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:18.470343 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:18.474944 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e068977a-143a-4a6a-87f8-c48ac1415feb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:18.475421 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e068977a-143a-4a6a-87f8-c48ac1415feb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:18.475851 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e068977a-143a-4a6a-87f8-c48ac1415feb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:18.476576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e068977a-143a-4a6a-87f8-c48ac1415feb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:18.477022 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e068977a-143a-4a6a-87f8-c48ac1415feb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:18.477439 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e068977a-143a-4a6a-87f8-c48ac1415feb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:18.506636 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e068977a-143a-4a6a-87f8-c48ac1415feb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045329 Aug 24 17:05:18.507171 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 596/1190] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 17:05:18 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:05:18.565113 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:18.566480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:18.570339 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-98db464b-40d6-4433-aa8b-fae562c25cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:18.570841 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-98db464b-40d6-4433-aa8b-fae562c25cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:18.577195 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-98db464b-40d6-4433-aa8b-fae562c25cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:18.578159 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-98db464b-40d6-4433-aa8b-fae562c25cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:18.578159 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-98db464b-40d6-4433-aa8b-fae562c25cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:18.578865 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-98db464b-40d6-4433-aa8b-fae562c25cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:18.579322 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-98db464b-40d6-4433-aa8b-fae562c25cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:18.579748 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-98db464b-40d6-4433-aa8b-fae562c25cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:18.603928 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-98db464b-40d6-4433-aa8b-fae562c25cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Going to try to terminate instance {{(pid=127715) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:05:18.890173 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-98db464b-40d6-4433-aa8b-fae562c25cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 204 len: 0 microversion: 2.1 time: 0.326411 Aug 24 17:05:18.890772 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 595/1191] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 17:05:18 2022] DELETE /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:05:18.898988 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a57ae9b8-1deb-4e43-a911-80b3adae8b71 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:18.899615 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a57ae9b8-1deb-4e43-a911-80b3adae8b71 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:18.907077 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a57ae9b8-1deb-4e43-a911-80b3adae8b71 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:18.907669 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a57ae9b8-1deb-4e43-a911-80b3adae8b71 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:18.908103 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a57ae9b8-1deb-4e43-a911-80b3adae8b71 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:18.908901 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a57ae9b8-1deb-4e43-a911-80b3adae8b71 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:18.909865 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a57ae9b8-1deb-4e43-a911-80b3adae8b71 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:18.910354 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a57ae9b8-1deb-4e43-a911-80b3adae8b71 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:19.042753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a57ae9b8-1deb-4e43-a911-80b3adae8b71 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:19.050379 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a57ae9b8-1deb-4e43-a911-80b3adae8b71 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1669 microversion: 2.1 time: 0.155312 Aug 24 17:05:19.050943 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 597/1192] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:18 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:20.072136 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ed08cc4b-21ff-47f2-968d-dcf5c5e16631 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:20.072866 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ed08cc4b-21ff-47f2-968d-dcf5c5e16631 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:20.079186 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ed08cc4b-21ff-47f2-968d-dcf5c5e16631 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:20.079670 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ed08cc4b-21ff-47f2-968d-dcf5c5e16631 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:20.080110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ed08cc4b-21ff-47f2-968d-dcf5c5e16631 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:20.080848 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ed08cc4b-21ff-47f2-968d-dcf5c5e16631 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:20.081311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ed08cc4b-21ff-47f2-968d-dcf5c5e16631 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:20.081741 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ed08cc4b-21ff-47f2-968d-dcf5c5e16631 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:20.208349 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ed08cc4b-21ff-47f2-968d-dcf5c5e16631 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:20.216347 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ed08cc4b-21ff-47f2-968d-dcf5c5e16631 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1669 microversion: 2.1 time: 0.148403 Aug 24 17:05:20.217263 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 596/1193] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:20 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:20.308019 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-922614515", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1973815301", "security_groups": [{"name": "tempest-secgroup-smoke-647078182"}], "block_device_mapping_v2": [{"uuid": "ed97d1ca-4071-4d97-8b47-f03f1e1f47ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b92bc0ae-a252-4a61-8a0b-b9b8262f1ac3"}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:05:20.416894 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] validate_networks() for [('b92bc0ae-a252-4a61-8a0b-b9b8262f1ac3', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:05:20.870813 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:05:20.871243 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:05:20.871744 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:05:20.872156 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:05:20.872603 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:05:20.881683 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:20.882161 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:20.882594 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:20.883318 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:20.883769 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:20.884190 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:20.901408 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Getting quotas for project 805d6de24ff4415c89cba2d318ffd2f4. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:05:20.905492 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Getting quotas for user 701be5a3cff34016ab22b6dc4d23d939 and project 805d6de24ff4415c89cba2d318ffd2f4. Resources: {'cores', 'ram', 'instances'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:05:20.961791 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:05:20.963907 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed97d1ca-4071-4d97-8b47-f03f1e1f47ed',volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:05:21.237579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-49193eae-e74b-4832-bbd8-8a1cfc95e801 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:21.238285 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-49193eae-e74b-4832-bbd8-8a1cfc95e801 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:21.244366 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-49193eae-e74b-4832-bbd8-8a1cfc95e801 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:21.244884 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-49193eae-e74b-4832-bbd8-8a1cfc95e801 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:21.245321 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-49193eae-e74b-4832-bbd8-8a1cfc95e801 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:21.246274 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-49193eae-e74b-4832-bbd8-8a1cfc95e801 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:21.246908 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-49193eae-e74b-4832-bbd8-8a1cfc95e801 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:21.247505 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-49193eae-e74b-4832-bbd8-8a1cfc95e801 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:21.340011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4abcbc48-ffdf-43d8-b362-8fa4659543c5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.035691 Aug 24 17:05:21.346459 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 598/1194] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 17:05:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:05:21.351704 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-77f817ab-7387-46a2-9730-8788668bc808 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:21.352557 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-77f817ab-7387-46a2-9730-8788668bc808 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:21.383432 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-49193eae-e74b-4832-bbd8-8a1cfc95e801 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:21.392590 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-49193eae-e74b-4832-bbd8-8a1cfc95e801 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1669 microversion: 2.1 time: 0.158776 Aug 24 17:05:21.394577 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 597/1195] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:21 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:21.412755 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-77f817ab-7387-46a2-9730-8788668bc808 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:21.420035 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-77f817ab-7387-46a2-9730-8788668bc808 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1094 microversion: 2.1 time: 0.072382 Aug 24 17:05:21.425170 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 599/1196] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:21 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:22.441620 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-74a0d236-6eed-4a90-a9ea-0bf27f110bb1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:22.442333 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-74a0d236-6eed-4a90-a9ea-0bf27f110bb1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:22.449663 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-74a0d236-6eed-4a90-a9ea-0bf27f110bb1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:22.450166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-74a0d236-6eed-4a90-a9ea-0bf27f110bb1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:22.450747 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-74a0d236-6eed-4a90-a9ea-0bf27f110bb1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:22.451504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-74a0d236-6eed-4a90-a9ea-0bf27f110bb1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:22.452012 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-74a0d236-6eed-4a90-a9ea-0bf27f110bb1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:22.452418 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-74a0d236-6eed-4a90-a9ea-0bf27f110bb1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:22.520322 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-74a0d236-6eed-4a90-a9ea-0bf27f110bb1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:22.539846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-74a0d236-6eed-4a90-a9ea-0bf27f110bb1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1144 microversion: 2.1 time: 0.091963 Aug 24 17:05:22.539846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 600/1197] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:22 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:22.642837 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3311e5a4-c77e-4114-a34d-5e42fc38a42d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:22.644185 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3311e5a4-c77e-4114-a34d-5e42fc38a42d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:22.650058 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3311e5a4-c77e-4114-a34d-5e42fc38a42d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:22.650553 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3311e5a4-c77e-4114-a34d-5e42fc38a42d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:22.650993 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3311e5a4-c77e-4114-a34d-5e42fc38a42d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:22.651705 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3311e5a4-c77e-4114-a34d-5e42fc38a42d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:22.652158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3311e5a4-c77e-4114-a34d-5e42fc38a42d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:22.652779 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3311e5a4-c77e-4114-a34d-5e42fc38a42d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:22.734729 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-3311e5a4-c77e-4114-a34d-5e42fc38a42d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:22.744309 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3311e5a4-c77e-4114-a34d-5e42fc38a42d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1603 microversion: 2.1 time: 0.332992 Aug 24 17:05:22.745275 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 598/1198] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:22 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1603 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:22.822261 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-55b07c79-ed65-4c3c-a837-47656a95ac7d req-072d5049-257c-4854-a68d-7e17cd5b00ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f799b07-9fb4-4890-841d-d4621c0a6980", "name": "network-vif-deleted", "tag": "e716512b-6e25-445c-a0e9-754d2f1c4c8c"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:05:22.832346 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-55b07c79-ed65-4c3c-a837-47656a95ac7d req-072d5049-257c-4854-a68d-7e17cd5b00ff service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:22.837661 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-55b07c79-ed65-4c3c-a837-47656a95ac7d req-072d5049-257c-4854-a68d-7e17cd5b00ff service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:22.837661 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-55b07c79-ed65-4c3c-a837-47656a95ac7d req-072d5049-257c-4854-a68d-7e17cd5b00ff service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:22.844953 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-55b07c79-ed65-4c3c-a837-47656a95ac7d req-072d5049-257c-4854-a68d-7e17cd5b00ff service nova] Creating event network-vif-deleted:e716512b-6e25-445c-a0e9-754d2f1c4c8c for instance 4f799b07-9fb4-4890-841d-d4621c0a6980 on hv-cinder-85220 Aug 24 17:05:22.850502 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-55b07c79-ed65-4c3c-a837-47656a95ac7d req-072d5049-257c-4854-a68d-7e17cd5b00ff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099680 Aug 24 17:05:22.851307 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 601/1199] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:05:23.551810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-003f328d-e7cb-49ac-b501-4feb2e1a80cb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:23.552934 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-003f328d-e7cb-49ac-b501-4feb2e1a80cb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:23.560815 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-003f328d-e7cb-49ac-b501-4feb2e1a80cb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:23.561245 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-003f328d-e7cb-49ac-b501-4feb2e1a80cb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:23.561754 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-003f328d-e7cb-49ac-b501-4feb2e1a80cb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:23.562523 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-003f328d-e7cb-49ac-b501-4feb2e1a80cb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:23.563605 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-003f328d-e7cb-49ac-b501-4feb2e1a80cb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:23.564038 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-003f328d-e7cb-49ac-b501-4feb2e1a80cb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:23.630486 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-003f328d-e7cb-49ac-b501-4feb2e1a80cb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:23.641371 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-003f328d-e7cb-49ac-b501-4feb2e1a80cb tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1200 microversion: 2.1 time: 0.094000 Aug 24 17:05:23.641959 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 599/1200] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:23 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1200 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:23.768962 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:23.769674 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:23.776067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:23.776655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:23.777066 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:23.784527 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:23.784527 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:23.784527 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:23.818368 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:23.819658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:23.820296 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:23.820954 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lazy-loading 'fault' on Instance uuid 4f799b07-9fb4-4890-841d-d4621c0a6980 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:05:23.902700 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:23.910520 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ef1ffff7-527d-4923-a5a7-e112db9b583f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 200 len: 1327 microversion: 2.1 time: 0.146856 Aug 24 17:05:23.911092 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 602/1201] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:23 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 1327 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:24.667655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-76b71554-02c0-4112-a442-fefc4fa25b29 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:24.667655 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-76b71554-02c0-4112-a442-fefc4fa25b29 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:24.673667 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-76b71554-02c0-4112-a442-fefc4fa25b29 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:24.674148 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-76b71554-02c0-4112-a442-fefc4fa25b29 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:24.674722 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-76b71554-02c0-4112-a442-fefc4fa25b29 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:24.675625 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-76b71554-02c0-4112-a442-fefc4fa25b29 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:24.676173 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-76b71554-02c0-4112-a442-fefc4fa25b29 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:24.676569 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-76b71554-02c0-4112-a442-fefc4fa25b29 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:24.809856 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-76b71554-02c0-4112-a442-fefc4fa25b29 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:24.818604 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-76b71554-02c0-4112-a442-fefc4fa25b29 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1277 microversion: 2.1 time: 0.156427 Aug 24 17:05:24.828617 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 600/1202] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:24 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:24.935124 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a88a279d-1673-470c-8b23-090d21386f3d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:24.936336 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a88a279d-1673-470c-8b23-090d21386f3d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:24.943197 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a88a279d-1673-470c-8b23-090d21386f3d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:24.947301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a88a279d-1673-470c-8b23-090d21386f3d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:24.947301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a88a279d-1673-470c-8b23-090d21386f3d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:24.947301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a88a279d-1673-470c-8b23-090d21386f3d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:24.947301 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a88a279d-1673-470c-8b23-090d21386f3d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:24.947736 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a88a279d-1673-470c-8b23-090d21386f3d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:24.960465 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-a88a279d-1673-470c-8b23-090d21386f3d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] HTTP exception thrown: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a88a279d-1673-470c-8b23-090d21386f3d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Request method failure captured: Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 HTTP/1.1 Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlkmvLwR33BvOQW80zwM7_V3z_tnI4Hu6YGvBHvlCu4VQYNnEAm4_f7kpKv0pXJHyPwkzQXnJ3o2cYAp_Vp96E2gVuwljQ2mgDHst9Q3uL8yoqwnvyVbS-AwbmnFDaNjtH_sefaYARSbQB9YewtKUvQHrhmmE9k0VFD4b47CNY-bYCM Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 19ac17f7efa644819e75576a06bb2499 Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 17:05:24.962130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 17:05:24.963975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_19ac17f7efa644819e75576a06bb2499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:05:24.963975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:05:24.963975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 19ac17f7efa644819e75576a06bb2499 Aug 24 17:05:24.963975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:05:24.963975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-AttachVolumeTestJSON-1132364335-project Aug 24 17:05:24.963975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 17:05:24.963975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 17:05:24.963975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 9d1076aed12f4d22a34df10ed0d8e462 Aug 24 17:05:24.963975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-AttachVolumeTestJSON-1132364335-project Aug 24 17:05:24.963975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 17:05:24.963975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:05:24.963975 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '4f799b07-9fb4-4890-841d-d4621c0a6980'} Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:05:24.965254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:05:24.967049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:05:24.968694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a88a279d-1673-470c-8b23-090d21386f3d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Returning 404 to user: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:05:24.968694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a88a279d-1673-470c-8b23-090d21386f3d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 404 len: 111 microversion: 2.1 time: 0.032295 Aug 24 17:05:24.968694 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 603/1203] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:24 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:05:24.972918 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-dfee785c-d09e-4348-a195-ee202c96e2af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '.version_select at 0x7fa195320940>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:25.062727 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-dfee785c-d09e-4348-a195-ee202c96e2af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-878298705" status: 202 len: 0 microversion: 2.1 time: 0.093834 Aug 24 17:05:25.063395 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 601/1204] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Aug 24 17:05:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-878298705 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:05:25.295650 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-46a69a45-cd2a-44fe-ad17-2ceb5603932d req-52a14ff6-1787-41b8-85e8-accdb0e68d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e95e11-1450-4d9b-bf94-3d03a5480108", "tag": "50088e1e-c41c-48a8-994e-b2c0a7bedbe0"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:05:25.309075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-46a69a45-cd2a-44fe-ad17-2ceb5603932d req-52a14ff6-1787-41b8-85e8-accdb0e68d27 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:25.309558 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-46a69a45-cd2a-44fe-ad17-2ceb5603932d req-52a14ff6-1787-41b8-85e8-accdb0e68d27 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:25.310467 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-46a69a45-cd2a-44fe-ad17-2ceb5603932d req-52a14ff6-1787-41b8-85e8-accdb0e68d27 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:25.322689 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-46a69a45-cd2a-44fe-ad17-2ceb5603932d req-52a14ff6-1787-41b8-85e8-accdb0e68d27 service nova] Creating event network-changed:50088e1e-c41c-48a8-994e-b2c0a7bedbe0 for instance 34e95e11-1450-4d9b-bf94-3d03a5480108 on hv-cinder-85220 Aug 24 17:05:25.327865 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-46a69a45-cd2a-44fe-ad17-2ceb5603932d req-52a14ff6-1787-41b8-85e8-accdb0e68d27 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035836 Aug 24 17:05:25.328671 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 604/1205] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:05:25.839277 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-def353dc-b762-4aaa-af75-fc2dd2e70e39 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:25.839983 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-def353dc-b762-4aaa-af75-fc2dd2e70e39 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:25.847583 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-def353dc-b762-4aaa-af75-fc2dd2e70e39 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:25.849013 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-def353dc-b762-4aaa-af75-fc2dd2e70e39 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:25.849013 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-def353dc-b762-4aaa-af75-fc2dd2e70e39 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:25.849426 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-def353dc-b762-4aaa-af75-fc2dd2e70e39 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:25.849881 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-def353dc-b762-4aaa-af75-fc2dd2e70e39 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:25.850300 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-def353dc-b762-4aaa-af75-fc2dd2e70e39 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:25.985572 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-def353dc-b762-4aaa-af75-fc2dd2e70e39 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:25.994202 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-def353dc-b762-4aaa-af75-fc2dd2e70e39 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1265 microversion: 2.1 time: 0.158968 Aug 24 17:05:26.004006 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 602/1206] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:25 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:26.162173 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-55f403dd-2c36-4d49-a5f6-f5b666a25aa5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Action: 'create', calling method: .version_select at 0x7fa1991648b0>, body: {"keypair": {"name": "tempest-keypair-583864407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGG1gJPDf6z+Y2b1AVMrstwavm8ZXshIX3YuDg+pn10tY3PajlroBJw4SBE50bsOzEEdLw91Atpa6W9mVMPEs4nPui+ACVn4Cr8ag+TW5dH2kVgOgmnRq19tOV4S4idXQ=="}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:05:26.177406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-55f403dd-2c36-4d49-a5f6-f5b666a25aa5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Getting quotas for project 19ac17f7efa644819e75576a06bb2499. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:05:26.181230 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-55f403dd-2c36-4d49-a5f6-f5b666a25aa5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Getting quotas for user 9d1076aed12f4d22a34df10ed0d8e462 and project 19ac17f7efa644819e75576a06bb2499. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:05:26.291179 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-55f403dd-2c36-4d49-a5f6-f5b666a25aa5 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.134253 Aug 24 17:05:26.292069 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 605/1207] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Aug 24 17:05:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:05:27.015327 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-6b0261eb-08b8-42da-9349-43f9a661a61b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:27.015882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-6b0261eb-08b8-42da-9349-43f9a661a61b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:27.022992 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6b0261eb-08b8-42da-9349-43f9a661a61b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:27.023485 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6b0261eb-08b8-42da-9349-43f9a661a61b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:27.023927 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6b0261eb-08b8-42da-9349-43f9a661a61b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:27.024748 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6b0261eb-08b8-42da-9349-43f9a661a61b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:27.025212 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6b0261eb-08b8-42da-9349-43f9a661a61b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:27.025643 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-6b0261eb-08b8-42da-9349-43f9a661a61b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:27.162103 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-6b0261eb-08b8-42da-9349-43f9a661a61b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:27.169905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-6b0261eb-08b8-42da-9349-43f9a661a61b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1265 microversion: 2.1 time: 0.158630 Aug 24 17:05:27.170466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 603/1208] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:27 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:28.190909 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7693a675-01c5-486a-b1e7-a4c3ed921b6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:28.191659 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7693a675-01c5-486a-b1e7-a4c3ed921b6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:28.197848 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7693a675-01c5-486a-b1e7-a4c3ed921b6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:28.198334 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7693a675-01c5-486a-b1e7-a4c3ed921b6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:28.198778 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7693a675-01c5-486a-b1e7-a4c3ed921b6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:28.199470 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7693a675-01c5-486a-b1e7-a4c3ed921b6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:28.199923 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7693a675-01c5-486a-b1e7-a4c3ed921b6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:28.200347 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7693a675-01c5-486a-b1e7-a4c3ed921b6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:28.214761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-711596726", "imageRef": "8571ef27-4e3e-42dd-9262-4397b63d210b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd5a5747-bc49-4240-ae73-1ffb40faec77"}], "security_groups": [{"name": "tempest-securitygroup--2009694613"}], "key_name": "tempest-keypair-583864407", "user_data": "}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:05:28.369406 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7693a675-01c5-486a-b1e7-a4c3ed921b6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:28.372363 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.network.neutron [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] validate_networks() for [('dd5a5747-bc49-4240-ae73-1ffb40faec77', None, None, None, None, None)] {{(pid=127715) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:05:28.377284 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7693a675-01c5-486a-b1e7-a4c3ed921b6a tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1265 microversion: 2.1 time: 0.190992 Aug 24 17:05:28.378492 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 606/1209] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:28 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:28.780773 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Flavor limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:05:28.781193 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Image limits 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:05:28.781664 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Flavor pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:05:28.782097 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Image pref 0:0:0 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:05:28.782504 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.virt.hardware [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:05:28.791734 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:28.792209 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:28.792669 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:28.793388 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:28.793836 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:28.794253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:28.810199 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Getting quotas for project 19ac17f7efa644819e75576a06bb2499. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:05:28.814054 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.quota [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Getting quotas for user 9d1076aed12f4d22a34df10ed0d8e462 and project 19ac17f7efa644819e75576a06bb2499. Resources: {'cores', 'ram', 'instances'} {{(pid=127715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:05:28.825295 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Going to run 1 instances... {{(pid=127715) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:05:28.827531 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8571ef27-4e3e-42dd-9262-4397b63d210b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:05:28.948690 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0be7e3a7-3ce1-4a77-8e27-0b93cf70aa2c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.738755 Aug 24 17:05:28.949333 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 604/1210] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Aug 24 17:05:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:05:28.959829 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4559e22e-052f-424b-a8e1-314e882760ac tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:28.960458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4559e22e-052f-424b-a8e1-314e882760ac tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:29.013277 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4559e22e-052f-424b-a8e1-314e882760ac tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:29.025048 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4559e22e-052f-424b-a8e1-314e882760ac tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1236 microversion: 2.1 time: 0.064023 Aug 24 17:05:29.025048 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 607/1211] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:28 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1236 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:29.399257 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e0f048d9-c89d-427f-b34b-c17961aebde5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:29.400005 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e0f048d9-c89d-427f-b34b-c17961aebde5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:29.406029 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0f048d9-c89d-427f-b34b-c17961aebde5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:29.406511 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0f048d9-c89d-427f-b34b-c17961aebde5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:29.406950 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0f048d9-c89d-427f-b34b-c17961aebde5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:29.407733 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0f048d9-c89d-427f-b34b-c17961aebde5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:29.408186 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0f048d9-c89d-427f-b34b-c17961aebde5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:29.408641 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0f048d9-c89d-427f-b34b-c17961aebde5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:29.559517 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-e0f048d9-c89d-427f-b34b-c17961aebde5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:29.559517 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e0f048d9-c89d-427f-b34b-c17961aebde5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1265 microversion: 2.1 time: 0.152781 Aug 24 17:05:29.559517 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 605/1212] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:29 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:30.043378 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-60245024-c281-4726-a53c-f5b6f7855adf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:30.043993 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-60245024-c281-4726-a53c-f5b6f7855adf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:30.051594 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60245024-c281-4726-a53c-f5b6f7855adf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:30.052075 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60245024-c281-4726-a53c-f5b6f7855adf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:30.052555 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60245024-c281-4726-a53c-f5b6f7855adf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:30.053268 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60245024-c281-4726-a53c-f5b6f7855adf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:30.053722 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60245024-c281-4726-a53c-f5b6f7855adf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:30.054146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60245024-c281-4726-a53c-f5b6f7855adf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:30.114041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-60245024-c281-4726-a53c-f5b6f7855adf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:30.121785 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-60245024-c281-4726-a53c-f5b6f7855adf tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1240 microversion: 2.1 time: 0.082402 Aug 24 17:05:30.122352 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 608/1213] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:30 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:30.568051 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9e788cc3-84e5-45a9-81e0-d4aa4f5fe003 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:30.568689 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9e788cc3-84e5-45a9-81e0-d4aa4f5fe003 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:30.575164 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e788cc3-84e5-45a9-81e0-d4aa4f5fe003 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:30.575649 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e788cc3-84e5-45a9-81e0-d4aa4f5fe003 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:30.576093 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e788cc3-84e5-45a9-81e0-d4aa4f5fe003 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:30.576827 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e788cc3-84e5-45a9-81e0-d4aa4f5fe003 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:30.577280 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e788cc3-84e5-45a9-81e0-d4aa4f5fe003 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:30.577706 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9e788cc3-84e5-45a9-81e0-d4aa4f5fe003 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:30.704563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9e788cc3-84e5-45a9-81e0-d4aa4f5fe003 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:30.712685 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9e788cc3-84e5-45a9-81e0-d4aa4f5fe003 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1265 microversion: 2.1 time: 0.148471 Aug 24 17:05:30.713256 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 606/1214] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:30 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:31.142355 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-546d751f-ecac-4be3-99f0-4d08b4602032 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:31.143550 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-546d751f-ecac-4be3-99f0-4d08b4602032 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:31.145520 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=2 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:31.150810 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-546d751f-ecac-4be3-99f0-4d08b4602032 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:31.151295 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-546d751f-ecac-4be3-99f0-4d08b4602032 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:31.151729 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-546d751f-ecac-4be3-99f0-4d08b4602032 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:31.152443 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-546d751f-ecac-4be3-99f0-4d08b4602032 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:31.152902 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-546d751f-ecac-4be3-99f0-4d08b4602032 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:31.153330 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-546d751f-ecac-4be3-99f0-4d08b4602032 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:31.219274 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-546d751f-ecac-4be3-99f0-4d08b4602032 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:31.227234 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-546d751f-ecac-4be3-99f0-4d08b4602032 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1296 microversion: 2.1 time: 0.088738 Aug 24 17:05:31.227803 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 609/1215] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:31 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:31.733975 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-39800c25-8bf4-42ce-97bc-4cea3e121355 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:31.734521 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-39800c25-8bf4-42ce-97bc-4cea3e121355 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:31.741627 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-39800c25-8bf4-42ce-97bc-4cea3e121355 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:31.742113 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-39800c25-8bf4-42ce-97bc-4cea3e121355 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:31.742543 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-39800c25-8bf4-42ce-97bc-4cea3e121355 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:31.743236 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-39800c25-8bf4-42ce-97bc-4cea3e121355 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:31.743686 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-39800c25-8bf4-42ce-97bc-4cea3e121355 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:31.744105 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-39800c25-8bf4-42ce-97bc-4cea3e121355 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:31.891163 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-39800c25-8bf4-42ce-97bc-4cea3e121355 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:31.899225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-39800c25-8bf4-42ce-97bc-4cea3e121355 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1265 microversion: 2.1 time: 0.169119 Aug 24 17:05:31.899796 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 607/1216] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:31 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:32.248914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2e5d02bc-d016-4465-a6cd-831d9332e891 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:32.249537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2e5d02bc-d016-4465-a6cd-831d9332e891 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:32.256768 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e5d02bc-d016-4465-a6cd-831d9332e891 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:32.257254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e5d02bc-d016-4465-a6cd-831d9332e891 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:32.257697 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e5d02bc-d016-4465-a6cd-831d9332e891 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:32.258395 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e5d02bc-d016-4465-a6cd-831d9332e891 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:32.258851 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e5d02bc-d016-4465-a6cd-831d9332e891 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:32.259298 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e5d02bc-d016-4465-a6cd-831d9332e891 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:32.386455 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2e5d02bc-d016-4465-a6cd-831d9332e891 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:32.394237 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2e5d02bc-d016-4465-a6cd-831d9332e891 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1362 microversion: 2.1 time: 0.149218 Aug 24 17:05:32.395109 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 610/1217] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:32 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:32.654992 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-045e179b-ce05-446a-96ad-a06eaa801381 req-84404ecd-2b99-4f82-89ae-0ddf84990464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a771788-4789-4218-986e-f9a56c84872b", "tag": "00d10204-5e77-45c4-b00c-95be03f003e4"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:05:32.664865 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-045e179b-ce05-446a-96ad-a06eaa801381 req-84404ecd-2b99-4f82-89ae-0ddf84990464 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:32.665341 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-045e179b-ce05-446a-96ad-a06eaa801381 req-84404ecd-2b99-4f82-89ae-0ddf84990464 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:32.665775 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-045e179b-ce05-446a-96ad-a06eaa801381 req-84404ecd-2b99-4f82-89ae-0ddf84990464 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:32.676960 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-045e179b-ce05-446a-96ad-a06eaa801381 req-84404ecd-2b99-4f82-89ae-0ddf84990464 service nova] Creating event network-changed:00d10204-5e77-45c4-b00c-95be03f003e4 for instance 6a771788-4789-4218-986e-f9a56c84872b on hv-cinder-85220 Aug 24 17:05:32.681872 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-045e179b-ce05-446a-96ad-a06eaa801381 req-84404ecd-2b99-4f82-89ae-0ddf84990464 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030596 Aug 24 17:05:32.682456 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 608/1218] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:05:32.920269 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce8bf746-a23a-4fc4-9305-2b0523d339ba tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:32.920909 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ce8bf746-a23a-4fc4-9305-2b0523d339ba tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:32.927693 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce8bf746-a23a-4fc4-9305-2b0523d339ba tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:32.928166 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce8bf746-a23a-4fc4-9305-2b0523d339ba tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:32.928625 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce8bf746-a23a-4fc4-9305-2b0523d339ba tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:32.929334 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce8bf746-a23a-4fc4-9305-2b0523d339ba tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:32.929788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce8bf746-a23a-4fc4-9305-2b0523d339ba tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:32.930641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce8bf746-a23a-4fc4-9305-2b0523d339ba tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:33.060930 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ce8bf746-a23a-4fc4-9305-2b0523d339ba tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:33.069064 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ce8bf746-a23a-4fc4-9305-2b0523d339ba tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1265 microversion: 2.1 time: 0.152744 Aug 24 17:05:33.069633 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 611/1219] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:32 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:33.415576 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b5189aa6-b2e9-4909-a70e-6109ee320a74 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:33.416294 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b5189aa6-b2e9-4909-a70e-6109ee320a74 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:33.422386 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5189aa6-b2e9-4909-a70e-6109ee320a74 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:33.422870 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5189aa6-b2e9-4909-a70e-6109ee320a74 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:33.423296 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5189aa6-b2e9-4909-a70e-6109ee320a74 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:33.423978 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5189aa6-b2e9-4909-a70e-6109ee320a74 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:33.425077 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5189aa6-b2e9-4909-a70e-6109ee320a74 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:33.425501 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b5189aa6-b2e9-4909-a70e-6109ee320a74 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:33.562131 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-b5189aa6-b2e9-4909-a70e-6109ee320a74 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:33.580072 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b5189aa6-b2e9-4909-a70e-6109ee320a74 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1362 microversion: 2.1 time: 0.169059 Aug 24 17:05:33.581414 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 609/1220] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:33 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:34.090464 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c630ce16-6900-4c47-bd8a-4d289b28bae4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:34.091171 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c630ce16-6900-4c47-bd8a-4d289b28bae4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:34.098811 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c630ce16-6900-4c47-bd8a-4d289b28bae4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:34.099305 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c630ce16-6900-4c47-bd8a-4d289b28bae4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:34.099771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c630ce16-6900-4c47-bd8a-4d289b28bae4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:34.100526 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c630ce16-6900-4c47-bd8a-4d289b28bae4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:34.100988 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c630ce16-6900-4c47-bd8a-4d289b28bae4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:34.101421 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c630ce16-6900-4c47-bd8a-4d289b28bae4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:34.243136 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c630ce16-6900-4c47-bd8a-4d289b28bae4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:34.251210 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c630ce16-6900-4c47-bd8a-4d289b28bae4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1265 microversion: 2.1 time: 0.164897 Aug 24 17:05:34.251801 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 612/1221] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:34 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:34.606835 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7186be3a-3be2-472d-b8e2-ec937b8cb2a6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:34.607444 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7186be3a-3be2-472d-b8e2-ec937b8cb2a6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:34.614507 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7186be3a-3be2-472d-b8e2-ec937b8cb2a6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:34.614985 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7186be3a-3be2-472d-b8e2-ec937b8cb2a6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:34.615427 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7186be3a-3be2-472d-b8e2-ec937b8cb2a6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:34.616113 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7186be3a-3be2-472d-b8e2-ec937b8cb2a6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:34.616598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7186be3a-3be2-472d-b8e2-ec937b8cb2a6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:34.617025 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7186be3a-3be2-472d-b8e2-ec937b8cb2a6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:34.744610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7186be3a-3be2-472d-b8e2-ec937b8cb2a6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:34.752067 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7186be3a-3be2-472d-b8e2-ec937b8cb2a6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1362 microversion: 2.1 time: 0.149155 Aug 24 17:05:34.752705 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 610/1222] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:34 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:35.272852 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d925f206-9afb-40c5-8fe3-c291decc1648 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:35.273473 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d925f206-9afb-40c5-8fe3-c291decc1648 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:35.279865 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d925f206-9afb-40c5-8fe3-c291decc1648 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:35.280331 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d925f206-9afb-40c5-8fe3-c291decc1648 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:35.280806 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d925f206-9afb-40c5-8fe3-c291decc1648 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:35.281502 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d925f206-9afb-40c5-8fe3-c291decc1648 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:35.281959 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d925f206-9afb-40c5-8fe3-c291decc1648 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:35.282385 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d925f206-9afb-40c5-8fe3-c291decc1648 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:35.412703 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d925f206-9afb-40c5-8fe3-c291decc1648 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:35.420383 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d925f206-9afb-40c5-8fe3-c291decc1648 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1265 microversion: 2.1 time: 0.151349 Aug 24 17:05:35.420974 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 613/1223] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:35 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:35.773491 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d6ffbdbb-0e3e-40bf-a324-7e0b11cf947f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:35.774107 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d6ffbdbb-0e3e-40bf-a324-7e0b11cf947f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:35.780544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d6ffbdbb-0e3e-40bf-a324-7e0b11cf947f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:35.781027 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d6ffbdbb-0e3e-40bf-a324-7e0b11cf947f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:35.781462 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d6ffbdbb-0e3e-40bf-a324-7e0b11cf947f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:35.782144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d6ffbdbb-0e3e-40bf-a324-7e0b11cf947f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:35.782597 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d6ffbdbb-0e3e-40bf-a324-7e0b11cf947f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:35.783016 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d6ffbdbb-0e3e-40bf-a324-7e0b11cf947f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:35.911682 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d6ffbdbb-0e3e-40bf-a324-7e0b11cf947f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:35.919210 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d6ffbdbb-0e3e-40bf-a324-7e0b11cf947f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1362 microversion: 2.1 time: 0.149583 Aug 24 17:05:35.919771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 611/1224] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:35 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:36.442302 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bd9558d7-7407-411f-9c31-48fbbb0e400c tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:36.442874 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bd9558d7-7407-411f-9c31-48fbbb0e400c tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:36.449559 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd9558d7-7407-411f-9c31-48fbbb0e400c tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:36.450041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd9558d7-7407-411f-9c31-48fbbb0e400c tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:36.450475 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd9558d7-7407-411f-9c31-48fbbb0e400c tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:36.451163 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd9558d7-7407-411f-9c31-48fbbb0e400c tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:36.451613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd9558d7-7407-411f-9c31-48fbbb0e400c tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:36.452035 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd9558d7-7407-411f-9c31-48fbbb0e400c tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:36.579731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bd9558d7-7407-411f-9c31-48fbbb0e400c tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:36.587537 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bd9558d7-7407-411f-9c31-48fbbb0e400c tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1265 microversion: 2.1 time: 0.149817 Aug 24 17:05:36.588137 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 614/1225] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:36 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:36.939146 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8aba484d-3c21-4804-bbc0-170702b456e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:36.939756 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-8aba484d-3c21-4804-bbc0-170702b456e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:36.945818 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8aba484d-3c21-4804-bbc0-170702b456e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:36.946310 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8aba484d-3c21-4804-bbc0-170702b456e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:36.946754 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8aba484d-3c21-4804-bbc0-170702b456e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:36.947491 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8aba484d-3c21-4804-bbc0-170702b456e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:36.948002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8aba484d-3c21-4804-bbc0-170702b456e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:36.948458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-8aba484d-3c21-4804-bbc0-170702b456e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:36.952540 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:37.080147 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-8aba484d-3c21-4804-bbc0-170702b456e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:37.088321 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8aba484d-3c21-4804-bbc0-170702b456e0 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1362 microversion: 2.1 time: 0.153100 Aug 24 17:05:37.088946 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 612/1226] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:36 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:37.607077 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-edf19835-4715-4ae7-8547-f5dc68282cc4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:37.607727 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-edf19835-4715-4ae7-8547-f5dc68282cc4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:37.614175 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-edf19835-4715-4ae7-8547-f5dc68282cc4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:37.614661 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-edf19835-4715-4ae7-8547-f5dc68282cc4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:37.615100 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-edf19835-4715-4ae7-8547-f5dc68282cc4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:37.615797 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-edf19835-4715-4ae7-8547-f5dc68282cc4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:37.616248 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-edf19835-4715-4ae7-8547-f5dc68282cc4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:37.616700 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-edf19835-4715-4ae7-8547-f5dc68282cc4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:37.747527 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-edf19835-4715-4ae7-8547-f5dc68282cc4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:37.755655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-edf19835-4715-4ae7-8547-f5dc68282cc4 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1265 microversion: 2.1 time: 0.152418 Aug 24 17:05:37.756258 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 615/1227] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:37 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:38.109127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-013c9bf3-f597-424f-9bb7-ebae31a1696c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:38.109739 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-013c9bf3-f597-424f-9bb7-ebae31a1696c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:38.116029 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-013c9bf3-f597-424f-9bb7-ebae31a1696c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:38.116577 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-013c9bf3-f597-424f-9bb7-ebae31a1696c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:38.133715 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-013c9bf3-f597-424f-9bb7-ebae31a1696c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:38.133715 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-013c9bf3-f597-424f-9bb7-ebae31a1696c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:38.133715 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-013c9bf3-f597-424f-9bb7-ebae31a1696c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:38.133715 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-013c9bf3-f597-424f-9bb7-ebae31a1696c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:38.245091 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-013c9bf3-f597-424f-9bb7-ebae31a1696c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:38.253240 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-013c9bf3-f597-424f-9bb7-ebae31a1696c tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1362 microversion: 2.1 time: 0.148066 Aug 24 17:05:38.254366 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 613/1228] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:38 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:38.431700 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-81548aac-a6db-4bad-8685-03bd28eb6375 req-c60076dc-d462-4fed-8d87-0c5ed4c37198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e95e11-1450-4d9b-bf94-3d03a5480108", "name": "network-vif-plugged", "status": "completed", "tag": "50088e1e-c41c-48a8-994e-b2c0a7bedbe0"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:05:38.445980 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-81548aac-a6db-4bad-8685-03bd28eb6375 req-c60076dc-d462-4fed-8d87-0c5ed4c37198 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:38.462246 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-81548aac-a6db-4bad-8685-03bd28eb6375 req-c60076dc-d462-4fed-8d87-0c5ed4c37198 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:38.462246 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-81548aac-a6db-4bad-8685-03bd28eb6375 req-c60076dc-d462-4fed-8d87-0c5ed4c37198 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:38.462246 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-81548aac-a6db-4bad-8685-03bd28eb6375 req-c60076dc-d462-4fed-8d87-0c5ed4c37198 service nova] Creating event network-vif-plugged:50088e1e-c41c-48a8-994e-b2c0a7bedbe0 for instance 34e95e11-1450-4d9b-bf94-3d03a5480108 on hv-cinder-85220 Aug 24 17:05:38.467731 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-81548aac-a6db-4bad-8685-03bd28eb6375 req-c60076dc-d462-4fed-8d87-0c5ed4c37198 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040904 Aug 24 17:05:38.468367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 616/1229] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:05:38.775892 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9172183a-68fb-48dc-aa4e-1c46b8fdff5e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:38.776560 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9172183a-68fb-48dc-aa4e-1c46b8fdff5e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:38.782799 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9172183a-68fb-48dc-aa4e-1c46b8fdff5e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:38.783366 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9172183a-68fb-48dc-aa4e-1c46b8fdff5e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:38.783819 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9172183a-68fb-48dc-aa4e-1c46b8fdff5e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:38.784556 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9172183a-68fb-48dc-aa4e-1c46b8fdff5e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:38.785019 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9172183a-68fb-48dc-aa4e-1c46b8fdff5e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:38.785453 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9172183a-68fb-48dc-aa4e-1c46b8fdff5e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:38.801140 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:38.821012 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell0:SELECT=6 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:38.929720 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9172183a-68fb-48dc-aa4e-1c46b8fdff5e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:38.937123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9172183a-68fb-48dc-aa4e-1c46b8fdff5e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1265 microversion: 2.1 time: 0.165187 Aug 24 17:05:38.937693 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 614/1230] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:38 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:39.275906 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0a9a8d0d-6454-494e-a0f6-265bb01e68ae tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:39.276655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0a9a8d0d-6454-494e-a0f6-265bb01e68ae tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:39.279009 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell0:SELECT=14 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:39.284049 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0a9a8d0d-6454-494e-a0f6-265bb01e68ae tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:39.284569 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0a9a8d0d-6454-494e-a0f6-265bb01e68ae tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:39.285011 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0a9a8d0d-6454-494e-a0f6-265bb01e68ae tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:39.285703 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0a9a8d0d-6454-494e-a0f6-265bb01e68ae tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:39.286160 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0a9a8d0d-6454-494e-a0f6-265bb01e68ae tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:39.286585 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0a9a8d0d-6454-494e-a0f6-265bb01e68ae tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:39.416843 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0a9a8d0d-6454-494e-a0f6-265bb01e68ae tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:39.424415 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0a9a8d0d-6454-494e-a0f6-265bb01e68ae tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1362 microversion: 2.1 time: 0.152834 Aug 24 17:05:39.424986 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 617/1231] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:39 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:39.958703 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-41acbbfc-785a-42b0-b83b-7c2d630cd856 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:39.959313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-41acbbfc-785a-42b0-b83b-7c2d630cd856 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:39.966412 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-41acbbfc-785a-42b0-b83b-7c2d630cd856 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:39.966893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-41acbbfc-785a-42b0-b83b-7c2d630cd856 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:39.967331 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-41acbbfc-785a-42b0-b83b-7c2d630cd856 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:39.968064 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-41acbbfc-785a-42b0-b83b-7c2d630cd856 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:39.968540 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-41acbbfc-785a-42b0-b83b-7c2d630cd856 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:39.968967 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-41acbbfc-785a-42b0-b83b-7c2d630cd856 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:40.344144 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-41acbbfc-785a-42b0-b83b-7c2d630cd856 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:40.350865 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-41acbbfc-785a-42b0-b83b-7c2d630cd856 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1265 microversion: 2.1 time: 0.396472 Aug 24 17:05:40.351432 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 615/1232] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:39 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1265 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:40.445407 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2485d5a4-6589-4b83-8398-b81ce181e5ba tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:40.446027 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2485d5a4-6589-4b83-8398-b81ce181e5ba tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:40.452612 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2485d5a4-6589-4b83-8398-b81ce181e5ba tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:40.453200 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2485d5a4-6589-4b83-8398-b81ce181e5ba tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:40.453530 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2485d5a4-6589-4b83-8398-b81ce181e5ba tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:40.454225 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2485d5a4-6589-4b83-8398-b81ce181e5ba tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:40.454675 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2485d5a4-6589-4b83-8398-b81ce181e5ba tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:40.455098 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2485d5a4-6589-4b83-8398-b81ce181e5ba tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:40.476372 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=100 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:40.483532 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-0863036e-fc1e-4766-9b2f-57ec89c36e92 req-b2286fd9-0e91-4a15-b5d4-01562973d413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a771788-4789-4218-986e-f9a56c84872b", "name": "network-vif-plugged", "status": "completed", "tag": "00d10204-5e77-45c4-b00c-95be03f003e4"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:05:40.492755 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-0863036e-fc1e-4766-9b2f-57ec89c36e92 req-b2286fd9-0e91-4a15-b5d4-01562973d413 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:40.493231 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-0863036e-fc1e-4766-9b2f-57ec89c36e92 req-b2286fd9-0e91-4a15-b5d4-01562973d413 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:40.493685 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-0863036e-fc1e-4766-9b2f-57ec89c36e92 req-b2286fd9-0e91-4a15-b5d4-01562973d413 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:40.505523 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-0863036e-fc1e-4766-9b2f-57ec89c36e92 req-b2286fd9-0e91-4a15-b5d4-01562973d413 service nova] Creating event network-vif-plugged:00d10204-5e77-45c4-b00c-95be03f003e4 for instance 6a771788-4789-4218-986e-f9a56c84872b on hv-cinder-85220 Aug 24 17:05:40.510474 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-0863036e-fc1e-4766-9b2f-57ec89c36e92 req-b2286fd9-0e91-4a15-b5d4-01562973d413 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030640 Aug 24 17:05:40.511103 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 616/1233] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:05:40.591316 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2485d5a4-6589-4b83-8398-b81ce181e5ba tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:40.599040 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2485d5a4-6589-4b83-8398-b81ce181e5ba tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1362 microversion: 2.1 time: 0.157467 Aug 24 17:05:40.599611 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 618/1234] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:40 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:41.372155 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-2b39e8c8-6d7b-4156-92c0-558682ce4f2d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:41.372864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-2b39e8c8-6d7b-4156-92c0-558682ce4f2d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:41.379711 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b39e8c8-6d7b-4156-92c0-558682ce4f2d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:41.385882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b39e8c8-6d7b-4156-92c0-558682ce4f2d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:41.385882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b39e8c8-6d7b-4156-92c0-558682ce4f2d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:41.385882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b39e8c8-6d7b-4156-92c0-558682ce4f2d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:41.385882 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b39e8c8-6d7b-4156-92c0-558682ce4f2d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:41.386287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-2b39e8c8-6d7b-4156-92c0-558682ce4f2d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:41.514100 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-2b39e8c8-6d7b-4156-92c0-558682ce4f2d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:41.522410 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-2b39e8c8-6d7b-4156-92c0-558682ce4f2d tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1453 microversion: 2.1 time: 0.154958 Aug 24 17:05:41.523391 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 617/1235] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:41 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:41.542235 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-269868aa-a1da-4cb0-bb6d-6b020247350b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:41.542922 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-269868aa-a1da-4cb0-bb6d-6b020247350b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:41.549108 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-269868aa-a1da-4cb0-bb6d-6b020247350b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:41.549604 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-269868aa-a1da-4cb0-bb6d-6b020247350b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:41.550043 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-269868aa-a1da-4cb0-bb6d-6b020247350b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:41.550779 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-269868aa-a1da-4cb0-bb6d-6b020247350b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:41.551235 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-269868aa-a1da-4cb0-bb6d-6b020247350b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:41.551679 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-269868aa-a1da-4cb0-bb6d-6b020247350b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:41.619418 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7fe31121-1f95-48e3-846c-fc1b49ce97cb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:41.620179 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-7fe31121-1f95-48e3-846c-fc1b49ce97cb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:41.626241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7fe31121-1f95-48e3-846c-fc1b49ce97cb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:41.626727 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7fe31121-1f95-48e3-846c-fc1b49ce97cb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:41.627158 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7fe31121-1f95-48e3-846c-fc1b49ce97cb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:41.627845 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7fe31121-1f95-48e3-846c-fc1b49ce97cb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:41.628293 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7fe31121-1f95-48e3-846c-fc1b49ce97cb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:41.629311 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-7fe31121-1f95-48e3-846c-fc1b49ce97cb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:41.710518 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-269868aa-a1da-4cb0-bb6d-6b020247350b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:41.718494 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-269868aa-a1da-4cb0-bb6d-6b020247350b tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1453 microversion: 2.1 time: 0.179959 Aug 24 17:05:41.719207 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 619/1236] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:41 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:41.782004 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-7fe31121-1f95-48e3-846c-fc1b49ce97cb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:41.789770 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7fe31121-1f95-48e3-846c-fc1b49ce97cb tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1362 microversion: 2.1 time: 0.174270 Aug 24 17:05:41.790772 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 618/1237] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:41 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:05:42.810360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a4bfdb9c-52b1-447c-afa0-bab667d48e5e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:42.810989 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a4bfdb9c-52b1-447c-afa0-bab667d48e5e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:42.818177 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4bfdb9c-52b1-447c-afa0-bab667d48e5e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:42.818669 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4bfdb9c-52b1-447c-afa0-bab667d48e5e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:42.819108 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4bfdb9c-52b1-447c-afa0-bab667d48e5e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:42.819894 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4bfdb9c-52b1-447c-afa0-bab667d48e5e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:42.820357 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4bfdb9c-52b1-447c-afa0-bab667d48e5e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:42.821168 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4bfdb9c-52b1-447c-afa0-bab667d48e5e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:42.951371 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a4bfdb9c-52b1-447c-afa0-bab667d48e5e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:42.959658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a4bfdb9c-52b1-447c-afa0-bab667d48e5e tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1362 microversion: 2.1 time: 0.153412 Aug 24 17:05:42.960238 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 620/1238] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:42 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:43.736808 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-39258520-5586-401b-97b6-46a9d8216bec req-f30df576-3efd-476f-8d93-d90d409a8f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e95e11-1450-4d9b-bf94-3d03a5480108", "tag": "50088e1e-c41c-48a8-994e-b2c0a7bedbe0"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:05:43.747364 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-39258520-5586-401b-97b6-46a9d8216bec req-f30df576-3efd-476f-8d93-d90d409a8f77 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:43.747844 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-39258520-5586-401b-97b6-46a9d8216bec req-f30df576-3efd-476f-8d93-d90d409a8f77 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:43.749373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-39258520-5586-401b-97b6-46a9d8216bec req-f30df576-3efd-476f-8d93-d90d409a8f77 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:43.760465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-39258520-5586-401b-97b6-46a9d8216bec req-f30df576-3efd-476f-8d93-d90d409a8f77 service nova] Creating event network-changed:50088e1e-c41c-48a8-994e-b2c0a7bedbe0 for instance 34e95e11-1450-4d9b-bf94-3d03a5480108 on hv-cinder-85220 Aug 24 17:05:43.765938 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-39258520-5586-401b-97b6-46a9d8216bec req-f30df576-3efd-476f-8d93-d90d409a8f77 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032802 Aug 24 17:05:43.766954 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 619/1239] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:05:43.980512 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0a2f971a-fec2-400e-9cb3-3a33e1cd69ea tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:43.981980 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0a2f971a-fec2-400e-9cb3-3a33e1cd69ea tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:43.989211 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0a2f971a-fec2-400e-9cb3-3a33e1cd69ea tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:43.990012 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0a2f971a-fec2-400e-9cb3-3a33e1cd69ea tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:43.990679 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0a2f971a-fec2-400e-9cb3-3a33e1cd69ea tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:43.991846 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0a2f971a-fec2-400e-9cb3-3a33e1cd69ea tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:43.992812 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0a2f971a-fec2-400e-9cb3-3a33e1cd69ea tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:43.993474 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0a2f971a-fec2-400e-9cb3-3a33e1cd69ea tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:44.130404 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0a2f971a-fec2-400e-9cb3-3a33e1cd69ea tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:05:44.139835 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0a2f971a-fec2-400e-9cb3-3a33e1cd69ea tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1546 microversion: 2.1 time: 0.163084 Aug 24 17:05:44.149239 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 621/1240] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:05:43 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:05:44.162227 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-b1da2c34-32f7-44c0-aef5-21bd18853660 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:05:44.163103 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-b1da2c34-32f7-44c0-aef5-21bd18853660 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:05:44.169774 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b1da2c34-32f7-44c0-aef5-21bd18853660 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:44.170272 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b1da2c34-32f7-44c0-aef5-21bd18853660 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:44.170712 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b1da2c34-32f7-44c0-aef5-21bd18853660 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:44.171416 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b1da2c34-32f7-44c0-aef5-21bd18853660 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:44.171880 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b1da2c34-32f7-44c0-aef5-21bd18853660 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:44.172312 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-b1da2c34-32f7-44c0-aef5-21bd18853660 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:44.252733 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-b1da2c34-32f7-44c0-aef5-21bd18853660 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095548 Aug 24 17:05:44.253340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 620/1241] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Aug 24 17:05:44 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:05:45.228872 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-539c8a73-07b1-467e-a2d9-e14bb64b71f3 req-399f8349-4c93-4910-9944-08b05b69c462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a771788-4789-4218-986e-f9a56c84872b", "tag": "00d10204-5e77-45c4-b00c-95be03f003e4"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:05:45.238558 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-539c8a73-07b1-467e-a2d9-e14bb64b71f3 req-399f8349-4c93-4910-9944-08b05b69c462 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:05:45.239147 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-539c8a73-07b1-467e-a2d9-e14bb64b71f3 req-399f8349-4c93-4910-9944-08b05b69c462 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:05:45.240090 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-539c8a73-07b1-467e-a2d9-e14bb64b71f3 req-399f8349-4c93-4910-9944-08b05b69c462 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:05:45.251133 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-539c8a73-07b1-467e-a2d9-e14bb64b71f3 req-399f8349-4c93-4910-9944-08b05b69c462 service nova] Creating event network-changed:00d10204-5e77-45c4-b00c-95be03f003e4 for instance 6a771788-4789-4218-986e-f9a56c84872b on hv-cinder-85220 Aug 24 17:05:45.256429 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-539c8a73-07b1-467e-a2d9-e14bb64b71f3 req-399f8349-4c93-4910-9944-08b05b69c462 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031301 Aug 24 17:05:45.257426 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 622/1242] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:12.995680 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:12.996546 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=42 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:13.001170 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-32e88b09-8a88-4cdb-8759-2ba1a232d1ac tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:13.001659 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-32e88b09-8a88-4cdb-8759-2ba1a232d1ac tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:13.007595 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-32e88b09-8a88-4cdb-8759-2ba1a232d1ac tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:13.008074 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-32e88b09-8a88-4cdb-8759-2ba1a232d1ac tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:13.008545 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-32e88b09-8a88-4cdb-8759-2ba1a232d1ac tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:13.009235 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-32e88b09-8a88-4cdb-8759-2ba1a232d1ac tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:13.009684 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-32e88b09-8a88-4cdb-8759-2ba1a232d1ac tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:13.010104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-32e88b09-8a88-4cdb-8759-2ba1a232d1ac tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:13.034053 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-32e88b09-8a88-4cdb-8759-2ba1a232d1ac tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/ips" status: 200 len: 144 microversion: 2.1 time: 0.040423 Aug 24 17:07:13.036491 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 621/1243] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Aug 24 17:07:12 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/ips => generated 144 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:14.617552 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:14.618321 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=22 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:14.622922 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9c08718b-4039-4a54-96f5-2592072a194f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d7758a8-7301-459e-a80f-9195f17f579b"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:07:14.627447 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9c08718b-4039-4a54-96f5-2592072a194f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:14.633360 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c08718b-4039-4a54-96f5-2592072a194f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:14.633930 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c08718b-4039-4a54-96f5-2592072a194f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:14.634523 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c08718b-4039-4a54-96f5-2592072a194f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:14.635342 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c08718b-4039-4a54-96f5-2592072a194f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:14.635920 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c08718b-4039-4a54-96f5-2592072a194f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:14.636470 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c08718b-4039-4a54-96f5-2592072a194f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:15.398952 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9c08718b-4039-4a54-96f5-2592072a194f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "POST /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783493 Aug 24 17:07:15.399752 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 623/1244] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 17:07:14 2022] POST /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments => generated 194 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:22.915648 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-0d892428-2a59-40fc-a07e-a3d48a72d777 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:22.920586 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-0d892428-2a59-40fc-a07e-a3d48a72d777 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:22.925035 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d892428-2a59-40fc-a07e-a3d48a72d777 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:22.925523 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d892428-2a59-40fc-a07e-a3d48a72d777 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:22.925993 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d892428-2a59-40fc-a07e-a3d48a72d777 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:22.926694 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d892428-2a59-40fc-a07e-a3d48a72d777 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:22.927151 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d892428-2a59-40fc-a07e-a3d48a72d777 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:22.927578 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-0d892428-2a59-40fc-a07e-a3d48a72d777 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:22.957377 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0d892428-2a59-40fc-a07e-a3d48a72d777 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046420 Aug 24 17:07:22.957940 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 622/1245] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 17:07:22 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:22.969201 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2e34df0b-65f1-4150-9729-e68f03f9f33a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:22.969762 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2e34df0b-65f1-4150-9729-e68f03f9f33a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:22.976465 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e34df0b-65f1-4150-9729-e68f03f9f33a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:22.976943 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e34df0b-65f1-4150-9729-e68f03f9f33a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:22.977374 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e34df0b-65f1-4150-9729-e68f03f9f33a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:22.978063 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e34df0b-65f1-4150-9729-e68f03f9f33a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:22.978509 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e34df0b-65f1-4150-9729-e68f03f9f33a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:22.978936 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e34df0b-65f1-4150-9729-e68f03f9f33a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:23.008499 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2e34df0b-65f1-4150-9729-e68f03f9f33a tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments/8d7758a8-7301-459e-a80f-9195f17f579b" status: 200 len: 194 microversion: 2.1 time: 0.043634 Aug 24 17:07:23.008999 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 624/1246] 10.222.0.70 () {58 vars in 1413 bytes} [Wed Aug 24 17:07:22 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments/8d7758a8-7301-459e-a80f-9195f17f579b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:24.566265 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-a64ab4d0-4987-4050-be37-93f76a03aa95 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0566f08c-aaba-46cd-a58e-8f319bd32f07"}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:07:24.568771 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-a64ab4d0-4987-4050-be37-93f76a03aa95 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:24.575588 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a64ab4d0-4987-4050-be37-93f76a03aa95 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:24.576079 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a64ab4d0-4987-4050-be37-93f76a03aa95 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:24.577224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a64ab4d0-4987-4050-be37-93f76a03aa95 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:24.579125 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a64ab4d0-4987-4050-be37-93f76a03aa95 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:24.579585 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a64ab4d0-4987-4050-be37-93f76a03aa95 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:24.580008 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-a64ab4d0-4987-4050-be37-93f76a03aa95 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:25.266500 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-a64ab4d0-4987-4050-be37-93f76a03aa95 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "POST /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.705129 Aug 24 17:07:25.267099 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 623/1247] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Aug 24 17:07:24 2022] POST /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments => generated 194 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:32.779168 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1237c041-e62b-49b3-b3a9-2d1cf55135af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:32.781535 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1237c041-e62b-49b3-b3a9-2d1cf55135af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:32.788144 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1237c041-e62b-49b3-b3a9-2d1cf55135af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:32.788710 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1237c041-e62b-49b3-b3a9-2d1cf55135af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:32.789142 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1237c041-e62b-49b3-b3a9-2d1cf55135af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:32.789833 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1237c041-e62b-49b3-b3a9-2d1cf55135af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:32.790286 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1237c041-e62b-49b3-b3a9-2d1cf55135af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:32.790710 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1237c041-e62b-49b3-b3a9-2d1cf55135af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:32.821328 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1237c041-e62b-49b3-b3a9-2d1cf55135af tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046056 Aug 24 17:07:32.821822 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 625/1248] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 17:07:32 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:32.964357 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-3d3e91b6-38fa-452a-a577-1f5d798bfef6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:32.965089 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-3d3e91b6-38fa-452a-a577-1f5d798bfef6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:32.971380 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d3e91b6-38fa-452a-a577-1f5d798bfef6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:32.976110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d3e91b6-38fa-452a-a577-1f5d798bfef6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:32.976110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d3e91b6-38fa-452a-a577-1f5d798bfef6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:32.976110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d3e91b6-38fa-452a-a577-1f5d798bfef6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:32.976110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d3e91b6-38fa-452a-a577-1f5d798bfef6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:32.976582 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-3d3e91b6-38fa-452a-a577-1f5d798bfef6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:33.003936 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-3d3e91b6-38fa-452a-a577-1f5d798bfef6 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments/8d7758a8-7301-459e-a80f-9195f17f579b" status: 200 len: 194 microversion: 2.1 time: 0.044355 Aug 24 17:07:33.004533 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 624/1249] 10.222.0.70 () {58 vars in 1413 bytes} [Wed Aug 24 17:07:32 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments/8d7758a8-7301-459e-a80f-9195f17f579b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:33.014615 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d56ec90c-9d5f-43a0-b6d2-30da1efc3cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:33.015107 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d56ec90c-9d5f-43a0-b6d2-30da1efc3cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:33.021215 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d56ec90c-9d5f-43a0-b6d2-30da1efc3cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:33.021687 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d56ec90c-9d5f-43a0-b6d2-30da1efc3cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:33.022117 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d56ec90c-9d5f-43a0-b6d2-30da1efc3cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:33.022794 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d56ec90c-9d5f-43a0-b6d2-30da1efc3cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:33.023237 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d56ec90c-9d5f-43a0-b6d2-30da1efc3cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:33.023651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d56ec90c-9d5f-43a0-b6d2-30da1efc3cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:33.101863 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-d56ec90c-9d5f-43a0-b6d2-30da1efc3cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lazy-loading 'services' on Instance uuid 6a771788-4789-4218-986e-f9a56c84872b {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:07:33.257203 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d56ec90c-9d5f-43a0-b6d2-30da1efc3cc1 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments/8d7758a8-7301-459e-a80f-9195f17f579b" status: 202 len: 0 microversion: 2.1 time: 0.246238 Aug 24 17:07:33.257874 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 626/1250] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Aug 24 17:07:33 2022] DELETE /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments/8d7758a8-7301-459e-a80f-9195f17f579b => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:07:35.428650 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d27f1c1b-d49e-4e70-9710-929140bd3d28 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:35.429172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d27f1c1b-d49e-4e70-9710-929140bd3d28 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:35.436164 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d27f1c1b-d49e-4e70-9710-929140bd3d28 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:35.436684 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d27f1c1b-d49e-4e70-9710-929140bd3d28 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:35.437119 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d27f1c1b-d49e-4e70-9710-929140bd3d28 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:35.437831 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d27f1c1b-d49e-4e70-9710-929140bd3d28 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:35.438286 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d27f1c1b-d49e-4e70-9710-929140bd3d28 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:35.438710 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d27f1c1b-d49e-4e70-9710-929140bd3d28 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:35.467061 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d27f1c1b-d49e-4e70-9710-929140bd3d28 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments/0566f08c-aaba-46cd-a58e-8f319bd32f07" status: 200 len: 194 microversion: 2.1 time: 0.042467 Aug 24 17:07:35.467852 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 625/1251] 10.222.0.70 () {58 vars in 1413 bytes} [Wed Aug 24 17:07:35 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments/0566f08c-aaba-46cd-a58e-8f319bd32f07 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:35.478902 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-49a7fe70-6a34-44fe-9eb6-667b0c331599 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:35.479480 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-49a7fe70-6a34-44fe-9eb6-667b0c331599 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:35.485656 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49a7fe70-6a34-44fe-9eb6-667b0c331599 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:35.486139 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49a7fe70-6a34-44fe-9eb6-667b0c331599 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:35.486576 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49a7fe70-6a34-44fe-9eb6-667b0c331599 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:35.487266 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49a7fe70-6a34-44fe-9eb6-667b0c331599 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:35.487715 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49a7fe70-6a34-44fe-9eb6-667b0c331599 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:35.488142 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49a7fe70-6a34-44fe-9eb6-667b0c331599 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:35.568848 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-49a7fe70-6a34-44fe-9eb6-667b0c331599 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lazy-loading 'services' on Instance uuid 6a771788-4789-4218-986e-f9a56c84872b {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:07:35.719164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-49a7fe70-6a34-44fe-9eb6-667b0c331599 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments/0566f08c-aaba-46cd-a58e-8f319bd32f07" status: 202 len: 0 microversion: 2.1 time: 0.244827 Aug 24 17:07:35.719753 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 627/1252] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Aug 24 17:07:35 2022] DELETE /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments/0566f08c-aaba-46cd-a58e-8f319bd32f07 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:07:36.888654 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-eaaf29e5-39fa-40ea-851f-9950640f67bc tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:36.890978 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-eaaf29e5-39fa-40ea-851f-9950640f67bc tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:36.897512 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eaaf29e5-39fa-40ea-851f-9950640f67bc tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:36.897999 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eaaf29e5-39fa-40ea-851f-9950640f67bc tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:36.898443 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eaaf29e5-39fa-40ea-851f-9950640f67bc tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:36.899131 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eaaf29e5-39fa-40ea-851f-9950640f67bc tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:36.899588 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eaaf29e5-39fa-40ea-851f-9950640f67bc tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:36.900014 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-eaaf29e5-39fa-40ea-851f-9950640f67bc tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:36.927822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-eaaf29e5-39fa-40ea-851f-9950640f67bc tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043795 Aug 24 17:07:36.928528 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 626/1253] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 17:07:36 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:07:37.040544 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-966e4f62-b6a4-4f3b-b82c-689c8626b33d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:37.043442 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-966e4f62-b6a4-4f3b-b82c-689c8626b33d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:37.049637 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-966e4f62-b6a4-4f3b-b82c-689c8626b33d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:37.050117 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-966e4f62-b6a4-4f3b-b82c-689c8626b33d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:37.050558 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-966e4f62-b6a4-4f3b-b82c-689c8626b33d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:37.051249 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-966e4f62-b6a4-4f3b-b82c-689c8626b33d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:37.051703 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-966e4f62-b6a4-4f3b-b82c-689c8626b33d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:37.052126 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-966e4f62-b6a4-4f3b-b82c-689c8626b33d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:37.079897 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-966e4f62-b6a4-4f3b-b82c-689c8626b33d tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044170 Aug 24 17:07:37.080458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 628/1254] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Aug 24 17:07:37 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:07:37.139635 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-fbf3ff83-cda3-4af4-a712-f050161ca279 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:37.140124 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fbf3ff83-cda3-4af4-a712-f050161ca279 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:37.145926 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fbf3ff83-cda3-4af4-a712-f050161ca279 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:37.146405 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fbf3ff83-cda3-4af4-a712-f050161ca279 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:37.146867 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fbf3ff83-cda3-4af4-a712-f050161ca279 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:37.147544 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fbf3ff83-cda3-4af4-a712-f050161ca279 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:37.147994 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fbf3ff83-cda3-4af4-a712-f050161ca279 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:37.148424 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-fbf3ff83-cda3-4af4-a712-f050161ca279 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:37.172466 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-fbf3ff83-cda3-4af4-a712-f050161ca279 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Going to try to terminate instance {{(pid=127715) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:07:37.423099 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-fbf3ff83-cda3-4af4-a712-f050161ca279 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 204 len: 0 microversion: 2.1 time: 0.286911 Aug 24 17:07:37.423682 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 627/1255] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 17:07:37 2022] DELETE /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:07:37.431834 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b9423ef6-71c5-4144-bc1c-e302a9770244 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:37.432489 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b9423ef6-71c5-4144-bc1c-e302a9770244 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:37.439150 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9423ef6-71c5-4144-bc1c-e302a9770244 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:37.439630 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9423ef6-71c5-4144-bc1c-e302a9770244 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:37.440074 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9423ef6-71c5-4144-bc1c-e302a9770244 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:37.440824 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9423ef6-71c5-4144-bc1c-e302a9770244 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:37.441279 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9423ef6-71c5-4144-bc1c-e302a9770244 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:37.441706 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9423ef6-71c5-4144-bc1c-e302a9770244 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:37.573507 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b9423ef6-71c5-4144-bc1c-e302a9770244 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:07:37.581328 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b9423ef6-71c5-4144-bc1c-e302a9770244 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1671 microversion: 2.1 time: 0.153305 Aug 24 17:07:37.581926 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 629/1256] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:37 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:07:38.604325 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5c4184a3-a8b6-49f7-bf79-a6410cfc36dd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:38.605070 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5c4184a3-a8b6-49f7-bf79-a6410cfc36dd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:38.611406 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5c4184a3-a8b6-49f7-bf79-a6410cfc36dd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:38.611888 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5c4184a3-a8b6-49f7-bf79-a6410cfc36dd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:38.612326 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5c4184a3-a8b6-49f7-bf79-a6410cfc36dd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:38.613039 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5c4184a3-a8b6-49f7-bf79-a6410cfc36dd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:38.613501 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5c4184a3-a8b6-49f7-bf79-a6410cfc36dd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:38.613926 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5c4184a3-a8b6-49f7-bf79-a6410cfc36dd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:38.743964 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-5c4184a3-a8b6-49f7-bf79-a6410cfc36dd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:07:38.752656 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5c4184a3-a8b6-49f7-bf79-a6410cfc36dd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1671 microversion: 2.1 time: 0.152475 Aug 24 17:07:38.753244 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 628/1257] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:38 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:07:39.773826 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9eb75e7f-3ea0-44c6-93e4-e5a1038bd332 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:39.774440 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9eb75e7f-3ea0-44c6-93e4-e5a1038bd332 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:39.781117 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9eb75e7f-3ea0-44c6-93e4-e5a1038bd332 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:39.782151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9eb75e7f-3ea0-44c6-93e4-e5a1038bd332 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:39.782151 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9eb75e7f-3ea0-44c6-93e4-e5a1038bd332 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:39.782687 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9eb75e7f-3ea0-44c6-93e4-e5a1038bd332 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:39.783187 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9eb75e7f-3ea0-44c6-93e4-e5a1038bd332 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:39.783589 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9eb75e7f-3ea0-44c6-93e4-e5a1038bd332 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:39.919317 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9eb75e7f-3ea0-44c6-93e4-e5a1038bd332 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:07:39.923346 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9eb75e7f-3ea0-44c6-93e4-e5a1038bd332 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1671 microversion: 2.1 time: 0.153401 Aug 24 17:07:39.923926 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 630/1258] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:39 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:07:40.472958 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-1e5005ed-c8fb-4b56-9137-9dd4cde6e944 req-a7ba4540-e1c2-4241-8f1d-98114443a6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a771788-4789-4218-986e-f9a56c84872b", "name": "network-vif-deleted", "tag": "00d10204-5e77-45c4-b00c-95be03f003e4"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:07:40.483512 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-1e5005ed-c8fb-4b56-9137-9dd4cde6e944 req-a7ba4540-e1c2-4241-8f1d-98114443a6dc service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:40.483994 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-1e5005ed-c8fb-4b56-9137-9dd4cde6e944 req-a7ba4540-e1c2-4241-8f1d-98114443a6dc service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:40.484452 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-1e5005ed-c8fb-4b56-9137-9dd4cde6e944 req-a7ba4540-e1c2-4241-8f1d-98114443a6dc service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:40.496130 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-1e5005ed-c8fb-4b56-9137-9dd4cde6e944 req-a7ba4540-e1c2-4241-8f1d-98114443a6dc service nova] Creating event network-vif-deleted:00d10204-5e77-45c4-b00c-95be03f003e4 for instance 6a771788-4789-4218-986e-f9a56c84872b on hv-cinder-85220 Aug 24 17:07:40.501394 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-1e5005ed-c8fb-4b56-9137-9dd4cde6e944 req-a7ba4540-e1c2-4241-8f1d-98114443a6dc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032175 Aug 24 17:07:40.502247 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 629/1259] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:40.944504 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:40.945130 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:40.952367 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:40.952924 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:40.953364 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:40.954067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:40.954522 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:40.954950 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:40.986123 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:40.986628 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:40.987118 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:40.987566 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lazy-loading 'fault' on Instance uuid 6a771788-4789-4218-986e-f9a56c84872b {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:07:41.029074 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1076aed12f4d22a34df10ed0d8e462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ac17f7efa644819e75576a06bb2499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:07:41.036726 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-84a0010d-5002-496d-877a-fa97873e3be4 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 200 len: 1326 microversion: 2.1 time: 0.096165 Aug 24 17:07:41.037293 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 631/1260] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:40 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:07:42.059346 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e0a7b980-a405-46f4-afc4-6e135b728e2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:42.060037 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-e0a7b980-a405-46f4-afc4-6e135b728e2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:42.066596 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0a7b980-a405-46f4-afc4-6e135b728e2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:42.067024 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0a7b980-a405-46f4-afc4-6e135b728e2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:42.067489 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0a7b980-a405-46f4-afc4-6e135b728e2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:42.068172 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0a7b980-a405-46f4-afc4-6e135b728e2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:42.068647 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0a7b980-a405-46f4-afc4-6e135b728e2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:42.069071 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-e0a7b980-a405-46f4-afc4-6e135b728e2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:42.082244 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-e0a7b980-a405-46f4-afc4-6e135b728e2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] HTTP exception thrown: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e0a7b980-a405-46f4-afc4-6e135b728e2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Request method failure captured: Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b HTTP/1.1 Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlkmvLwR33BvOQW80zwM7_V3z_tnI4Hu6YGvBHvlCu4VQYNnEAm4_f7kpKv0pXJHyPwkzQXnJ3o2cYAp_Vp96E2gVuwljQ2mgDHst9Q3uL8yoqwnvyVbS-AwbmnFDaNjtH_sefaYARSbQB9YewtKUvQHrhmmE9k0VFD4b47CNY-bYCM Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 19ac17f7efa644819e75576a06bb2499 Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 17:07:42.083893 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 17:07:42.085761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_19ac17f7efa644819e75576a06bb2499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:07:42.085761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:42.085761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 19ac17f7efa644819e75576a06bb2499 Aug 24 17:07:42.085761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:42.085761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-AttachVolumeTestJSON-1132364335-project Aug 24 17:07:42.085761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 17:07:42.085761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 17:07:42.085761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 9d1076aed12f4d22a34df10ed0d8e462 Aug 24 17:07:42.085761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-AttachVolumeTestJSON-1132364335-project Aug 24 17:07:42.085761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 17:07:42.085761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:42.085761 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '6a771788-4789-4218-986e-f9a56c84872b'} Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:07:42.086742 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:42.088518 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:42.090754 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-e0a7b980-a405-46f4-afc4-6e135b728e2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Returning 404 to user: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:07:42.090754 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-e0a7b980-a405-46f4-afc4-6e135b728e2f tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 404 len: 111 microversion: 2.1 time: 0.030913 Aug 24 17:07:42.090754 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 630/1261] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:42 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:07:42.095938 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d5d852ed-c281-4ab6-9d42-12e880391812 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '.version_select at 0x7fa194ad5550>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:42.246805 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d5d852ed-c281-4ab6-9d42-12e880391812 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-583864407" status: 202 len: 0 microversion: 2.1 time: 0.154532 Aug 24 17:07:42.247488 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 632/1262] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Aug 24 17:07:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-583864407 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:07:45.537074 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ad8678fd-5b54-4f87-b97f-a11dee018c09 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:45.537579 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ad8678fd-5b54-4f87-b97f-a11dee018c09 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:45.544597 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad8678fd-5b54-4f87-b97f-a11dee018c09 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:45.545086 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad8678fd-5b54-4f87-b97f-a11dee018c09 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:45.545529 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad8678fd-5b54-4f87-b97f-a11dee018c09 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:45.546224 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad8678fd-5b54-4f87-b97f-a11dee018c09 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:45.546679 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad8678fd-5b54-4f87-b97f-a11dee018c09 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:45.547102 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ad8678fd-5b54-4f87-b97f-a11dee018c09 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:45.561377 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-ad8678fd-5b54-4f87-b97f-a11dee018c09 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] HTTP exception thrown: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ad8678fd-5b54-4f87-b97f-a11dee018c09 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Request method failure captured: Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: DELETE /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b HTTP/1.1 Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlkmvLwR33BvOQW80zwM7_V3z_tnI4Hu6YGvBHvlCu4VQYNnEAm4_f7kpKv0pXJHyPwkzQXnJ3o2cYAp_Vp96E2gVuwljQ2mgDHst9Q3uL8yoqwnvyVbS-AwbmnFDaNjtH_sefaYARSbQB9YewtKUvQHrhmmE9k0VFD4b47CNY-bYCM Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 19ac17f7efa644819e75576a06bb2499 Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 17:07:45.562924 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 17:07:45.564495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_19ac17f7efa644819e75576a06bb2499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:07:45.564495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:45.564495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 19ac17f7efa644819e75576a06bb2499 Aug 24 17:07:45.564495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:45.564495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-AttachVolumeTestJSON-1132364335-project Aug 24 17:07:45.564495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 17:07:45.564495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 17:07:45.564495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 9d1076aed12f4d22a34df10ed0d8e462 Aug 24 17:07:45.564495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-AttachVolumeTestJSON-1132364335-project Aug 24 17:07:45.564495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 17:07:45.564495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:45.564495 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '6a771788-4789-4218-986e-f9a56c84872b'} Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:07:45.565372 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:45.566905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:45.573841 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ad8678fd-5b54-4f87-b97f-a11dee018c09 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Returning 404 to user: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:07:45.573841 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ad8678fd-5b54-4f87-b97f-a11dee018c09 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 404 len: 111 microversion: 2.1 time: 0.031173 Aug 24 17:07:45.573841 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 631/1263] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 17:07:45 2022] DELETE /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:07:45.574141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f465963b-edf3-459d-aa65-2d6590358d33 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:45.574141 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f465963b-edf3-459d-aa65-2d6590358d33 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 6a771788-4789-4218-986e-f9a56c84872b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:45.576496 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:45.581848 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f465963b-edf3-459d-aa65-2d6590358d33 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:45.582332 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f465963b-edf3-459d-aa65-2d6590358d33 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:45.582773 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f465963b-edf3-459d-aa65-2d6590358d33 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:45.583463 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f465963b-edf3-459d-aa65-2d6590358d33 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:45.583947 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f465963b-edf3-459d-aa65-2d6590358d33 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:45.584377 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f465963b-edf3-459d-aa65-2d6590358d33 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:45.588309 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG dbcounter [-] [127716] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:45.597492 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-f465963b-edf3-459d-aa65-2d6590358d33 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] HTTP exception thrown: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f465963b-edf3-459d-aa65-2d6590358d33 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Request method failure captured: Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b HTTP/1.1 Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlkmvLwR33BvOQW80zwM7_V3z_tnI4Hu6YGvBHvlCu4VQYNnEAm4_f7kpKv0pXJHyPwkzQXnJ3o2cYAp_Vp96E2gVuwljQ2mgDHst9Q3uL8yoqwnvyVbS-AwbmnFDaNjtH_sefaYARSbQB9YewtKUvQHrhmmE9k0VFD4b47CNY-bYCM Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 19ac17f7efa644819e75576a06bb2499 Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 17:07:45.602060 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 17:07:45.603782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_19ac17f7efa644819e75576a06bb2499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:07:45.603782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:45.603782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 19ac17f7efa644819e75576a06bb2499 Aug 24 17:07:45.603782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:45.603782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-AttachVolumeTestJSON-1132364335-project Aug 24 17:07:45.603782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 17:07:45.603782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 17:07:45.603782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 9d1076aed12f4d22a34df10ed0d8e462 Aug 24 17:07:45.603782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-AttachVolumeTestJSON-1132364335-project Aug 24 17:07:45.603782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 17:07:45.603782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:45.603782 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '6a771788-4789-4218-986e-f9a56c84872b'} Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:07:45.605423 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. Aug 24 17:07:45.607041 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:45.608993 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f465963b-edf3-459d-aa65-2d6590358d33 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Returning 404 to user: Instance 6a771788-4789-4218-986e-f9a56c84872b could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:07:45.608993 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f465963b-edf3-459d-aa65-2d6590358d33 tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b" status: 404 len: 111 microversion: 2.1 time: 0.031433 Aug 24 17:07:45.608993 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 633/1264] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:45 2022] GET /compute/v2.1/servers/6a771788-4789-4218-986e-f9a56c84872b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:07:46.864253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-df9a8e3f-1d58-4b4c-b131-fe8056e04c0b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:46.864856 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-df9a8e3f-1d58-4b4c-b131-fe8056e04c0b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:46.871424 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df9a8e3f-1d58-4b4c-b131-fe8056e04c0b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:46.871883 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df9a8e3f-1d58-4b4c-b131-fe8056e04c0b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:46.872387 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df9a8e3f-1d58-4b4c-b131-fe8056e04c0b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:46.873169 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df9a8e3f-1d58-4b4c-b131-fe8056e04c0b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:46.873691 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df9a8e3f-1d58-4b4c-b131-fe8056e04c0b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:46.874192 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-df9a8e3f-1d58-4b4c-b131-fe8056e04c0b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:46.887898 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-df9a8e3f-1d58-4b4c-b131-fe8056e04c0b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] HTTP exception thrown: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-df9a8e3f-1d58-4b4c-b131-fe8056e04c0b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Request method failure captured: Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: DELETE /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 HTTP/1.1 Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlkmvLwR33BvOQW80zwM7_V3z_tnI4Hu6YGvBHvlCu4VQYNnEAm4_f7kpKv0pXJHyPwkzQXnJ3o2cYAp_Vp96E2gVuwljQ2mgDHst9Q3uL8yoqwnvyVbS-AwbmnFDaNjtH_sefaYARSbQB9YewtKUvQHrhmmE9k0VFD4b47CNY-bYCM Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 19ac17f7efa644819e75576a06bb2499 Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 17:07:46.889465 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 17:07:46.891225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_19ac17f7efa644819e75576a06bb2499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:07:46.891225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:46.891225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 19ac17f7efa644819e75576a06bb2499 Aug 24 17:07:46.891225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:46.891225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-AttachVolumeTestJSON-1132364335-project Aug 24 17:07:46.891225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 17:07:46.891225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 17:07:46.891225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 9d1076aed12f4d22a34df10ed0d8e462 Aug 24 17:07:46.891225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-AttachVolumeTestJSON-1132364335-project Aug 24 17:07:46.891225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 17:07:46.891225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:07:46.891225 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '4f799b07-9fb4-4890-841d-d4621c0a6980'} Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:07:46.892340 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:07:46.893977 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:46.895549 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-df9a8e3f-1d58-4b4c-b131-fe8056e04c0b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Returning 404 to user: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:07:46.895549 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-df9a8e3f-1d58-4b4c-b131-fe8056e04c0b tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 404 len: 111 microversion: 2.1 time: 0.030448 Aug 24 17:07:46.895549 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 632/1265] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 17:07:46 2022] DELETE /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:07:46.899498 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d7237a64-d2e8-4159-8c11-1cd58c1ca2cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:46.900338 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d7237a64-d2e8-4159-8c11-1cd58c1ca2cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] [instance: 4f799b07-9fb4-4890-841d-d4621c0a6980] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:46.908842 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7237a64-d2e8-4159-8c11-1cd58c1ca2cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:46.909272 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7237a64-d2e8-4159-8c11-1cd58c1ca2cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:46.909711 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7237a64-d2e8-4159-8c11-1cd58c1ca2cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:46.910580 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7237a64-d2e8-4159-8c11-1cd58c1ca2cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:46.911047 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7237a64-d2e8-4159-8c11-1cd58c1ca2cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:46.911480 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7237a64-d2e8-4159-8c11-1cd58c1ca2cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:46.925886 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-d7237a64-d2e8-4159-8c11-1cd58c1ca2cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] HTTP exception thrown: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d7237a64-d2e8-4159-8c11-1cd58c1ca2cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Request method failure captured: Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 HTTP/1.1 Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlkmvLwR33BvOQW80zwM7_V3z_tnI4Hu6YGvBHvlCu4VQYNnEAm4_f7kpKv0pXJHyPwkzQXnJ3o2cYAp_Vp96E2gVuwljQ2mgDHst9Q3uL8yoqwnvyVbS-AwbmnFDaNjtH_sefaYARSbQB9YewtKUvQHrhmmE9k0VFD4b47CNY-bYCM Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 19ac17f7efa644819e75576a06bb2499 Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 17:07:46.927412 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 17:07:46.929189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_19ac17f7efa644819e75576a06bb2499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/19ac17f7efa644819e75576a06bb2499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:07:46.929189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:46.929189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 19ac17f7efa644819e75576a06bb2499 Aug 24 17:07:46.929189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1132364335 Aug 24 17:07:46.929189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-AttachVolumeTestJSON-1132364335-project Aug 24 17:07:46.929189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 17:07:46.929189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 17:07:46.929189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 9d1076aed12f4d22a34df10ed0d8e462 Aug 24 17:07:46.929189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-AttachVolumeTestJSON-1132364335-project Aug 24 17:07:46.929189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 17:07:46.929189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:07:46.929189 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '4f799b07-9fb4-4890-841d-d4621c0a6980'} Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:07:46.940917 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. Aug 24 17:07:46.943516 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:46.945212 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d7237a64-d2e8-4159-8c11-1cd58c1ca2cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] Returning 404 to user: Instance 4f799b07-9fb4-4890-841d-d4621c0a6980 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:07:46.945212 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d7237a64-d2e8-4159-8c11-1cd58c1ca2cd tempest-AttachVolumeTestJSON-1132364335 tempest-AttachVolumeTestJSON-1132364335-project] 10.222.0.70 "GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980" status: 404 len: 111 microversion: 2.1 time: 0.033197 Aug 24 17:07:46.945212 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 634/1266] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:46 2022] GET /compute/v2.1/servers/4f799b07-9fb4-4890-841d-d4621c0a6980 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:07:47.543943 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9797c0e5-5a69-405c-b472-6ed2439b1220 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:47.544475 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9797c0e5-5a69-405c-b472-6ed2439b1220 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:47.552811 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9797c0e5-5a69-405c-b472-6ed2439b1220 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:47.556901 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9797c0e5-5a69-405c-b472-6ed2439b1220 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:47.556901 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9797c0e5-5a69-405c-b472-6ed2439b1220 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:47.556901 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9797c0e5-5a69-405c-b472-6ed2439b1220 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:47.557230 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9797c0e5-5a69-405c-b472-6ed2439b1220 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:47.557678 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9797c0e5-5a69-405c-b472-6ed2439b1220 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:47.586323 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9797c0e5-5a69-405c-b472-6ed2439b1220 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Going to try to terminate instance {{(pid=127715) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:07:47.616245 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-7112c30d-a8d8-410e-b032-7559961c1d0c req-e950f1ff-5e99-42d0-9fe0-0a4075044830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e95e11-1450-4d9b-bf94-3d03a5480108", "tag": "50088e1e-c41c-48a8-994e-b2c0a7bedbe0"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:07:47.628027 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-7112c30d-a8d8-410e-b032-7559961c1d0c req-e950f1ff-5e99-42d0-9fe0-0a4075044830 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:47.628844 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-7112c30d-a8d8-410e-b032-7559961c1d0c req-e950f1ff-5e99-42d0-9fe0-0a4075044830 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:47.629651 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-7112c30d-a8d8-410e-b032-7559961c1d0c req-e950f1ff-5e99-42d0-9fe0-0a4075044830 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:47.645791 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-7112c30d-a8d8-410e-b032-7559961c1d0c req-e950f1ff-5e99-42d0-9fe0-0a4075044830 service nova] Creating event network-changed:50088e1e-c41c-48a8-994e-b2c0a7bedbe0 for instance 34e95e11-1450-4d9b-bf94-3d03a5480108 on hv-cinder-85220 Aug 24 17:07:47.651820 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-7112c30d-a8d8-410e-b032-7559961c1d0c req-e950f1ff-5e99-42d0-9fe0-0a4075044830 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117699 Aug 24 17:07:47.652864 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 635/1267] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:47.841511 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9797c0e5-5a69-405c-b472-6ed2439b1220 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "DELETE /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 204 len: 0 microversion: 2.1 time: 0.310779 Aug 24 17:07:47.842110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 633/1268] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 17:07:47 2022] DELETE /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:07:47.852158 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8779ebf0-637e-46a7-9d20-a1aba2216090 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:47.852906 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8779ebf0-637e-46a7-9d20-a1aba2216090 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:47.863353 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8779ebf0-637e-46a7-9d20-a1aba2216090 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:47.863837 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8779ebf0-637e-46a7-9d20-a1aba2216090 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:47.864267 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8779ebf0-637e-46a7-9d20-a1aba2216090 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:47.864999 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8779ebf0-637e-46a7-9d20-a1aba2216090 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:47.865451 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8779ebf0-637e-46a7-9d20-a1aba2216090 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:47.866085 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8779ebf0-637e-46a7-9d20-a1aba2216090 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:48.012832 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8779ebf0-637e-46a7-9d20-a1aba2216090 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:07:48.021244 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8779ebf0-637e-46a7-9d20-a1aba2216090 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1578 microversion: 2.1 time: 0.174393 Aug 24 17:07:48.030809 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 636/1269] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:47 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:07:49.043147 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-29379599-9ff7-4d4e-b373-01009bdc23e5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:49.044584 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-29379599-9ff7-4d4e-b373-01009bdc23e5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:49.051318 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-29379599-9ff7-4d4e-b373-01009bdc23e5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:49.052138 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-29379599-9ff7-4d4e-b373-01009bdc23e5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:49.052841 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-29379599-9ff7-4d4e-b373-01009bdc23e5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:49.053783 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-29379599-9ff7-4d4e-b373-01009bdc23e5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:49.054467 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-29379599-9ff7-4d4e-b373-01009bdc23e5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:49.055137 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-29379599-9ff7-4d4e-b373-01009bdc23e5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:49.265610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-29379599-9ff7-4d4e-b373-01009bdc23e5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:07:49.279632 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-29379599-9ff7-4d4e-b373-01009bdc23e5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1578 microversion: 2.1 time: 0.235073 Aug 24 17:07:49.279632 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 634/1270] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:49 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:07:50.045337 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-853c4f6d-2ee4-451f-a902-4aefb624dad3 req-3846e433-63fb-44a2-b0e1-32345e48875b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e95e11-1450-4d9b-bf94-3d03a5480108", "name": "network-vif-deleted", "tag": "50088e1e-c41c-48a8-994e-b2c0a7bedbe0"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:07:50.058428 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-853c4f6d-2ee4-451f-a902-4aefb624dad3 req-3846e433-63fb-44a2-b0e1-32345e48875b service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:50.058931 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-853c4f6d-2ee4-451f-a902-4aefb624dad3 req-3846e433-63fb-44a2-b0e1-32345e48875b service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:50.059562 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-853c4f6d-2ee4-451f-a902-4aefb624dad3 req-3846e433-63fb-44a2-b0e1-32345e48875b service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:50.072467 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-853c4f6d-2ee4-451f-a902-4aefb624dad3 req-3846e433-63fb-44a2-b0e1-32345e48875b service nova] Creating event network-vif-deleted:50088e1e-c41c-48a8-994e-b2c0a7bedbe0 for instance 34e95e11-1450-4d9b-bf94-3d03a5480108 on hv-cinder-85220 Aug 24 17:07:50.082548 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-853c4f6d-2ee4-451f-a902-4aefb624dad3 req-3846e433-63fb-44a2-b0e1-32345e48875b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042259 Aug 24 17:07:50.084991 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 637/1271] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:50.297267 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-d2339ac7-59bf-4a87-892b-fa0aee649d2e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:50.297790 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-d2339ac7-59bf-4a87-892b-fa0aee649d2e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:50.315919 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2339ac7-59bf-4a87-892b-fa0aee649d2e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:50.317589 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2339ac7-59bf-4a87-892b-fa0aee649d2e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:50.318033 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2339ac7-59bf-4a87-892b-fa0aee649d2e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:50.318822 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2339ac7-59bf-4a87-892b-fa0aee649d2e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:50.319820 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2339ac7-59bf-4a87-892b-fa0aee649d2e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:50.320485 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-d2339ac7-59bf-4a87-892b-fa0aee649d2e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:50.426408 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-d2339ac7-59bf-4a87-892b-fa0aee649d2e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:07:50.430759 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:50.436860 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-d2339ac7-59bf-4a87-892b-fa0aee649d2e tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 200 len: 1225 microversion: 2.1 time: 0.143429 Aug 24 17:07:50.437780 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 635/1272] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:50 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:07:51.460884 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f4c6322f-e079-4b8d-834d-fe07279f5a74 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:51.461613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f4c6322f-e079-4b8d-834d-fe07279f5a74 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 34e95e11-1450-4d9b-bf94-3d03a5480108] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:51.467658 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4c6322f-e079-4b8d-834d-fe07279f5a74 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:51.468132 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4c6322f-e079-4b8d-834d-fe07279f5a74 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:51.468594 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4c6322f-e079-4b8d-834d-fe07279f5a74 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:51.469281 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4c6322f-e079-4b8d-834d-fe07279f5a74 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:51.469728 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4c6322f-e079-4b8d-834d-fe07279f5a74 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:51.470145 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4c6322f-e079-4b8d-834d-fe07279f5a74 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:51.483639 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-f4c6322f-e079-4b8d-834d-fe07279f5a74 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] HTTP exception thrown: Instance 34e95e11-1450-4d9b-bf94-3d03a5480108 could not be found. Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f4c6322f-e079-4b8d-834d-fe07279f5a74 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Request method failure captured: Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 HTTP/1.1 Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlijBbk2OFKfNW9n0JDtNbrOD1V5gSg_Z7lqVZ0UtERqNjaty6_5Fsg-xF4h7HqVMhCWZMh7YeuHNGU66z_YHZyvqKrBbHCMhFWp_j7qLSDUBTwDVxsIdAriuN7ViyOVkCR6jAC6X-6GoHuLVM7bG1Z7kifFnKa-ZNuAUGeSja66JLc Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 805d6de24ff4415c89cba2d318ffd2f4 Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 17:07:51.485254 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 17:07:51.487026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:07:51.487026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:07:51.487026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 805d6de24ff4415c89cba2d318ffd2f4 Aug 24 17:07:51.487026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:07:51.487026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-TestVolumeBootPattern-1985410155-project Aug 24 17:07:51.487026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 17:07:51.487026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 17:07:51.487026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 701be5a3cff34016ab22b6dc4d23d939 Aug 24 17:07:51.487026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-TestVolumeBootPattern-1985410155-project Aug 24 17:07:51.487026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 17:07:51.487026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 34e95e11-1450-4d9b-bf94-3d03a5480108 could not be found. Aug 24 17:07:51.487026 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '34e95e11-1450-4d9b-bf94-3d03a5480108'} Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34e95e11-1450-4d9b-bf94-3d03a5480108 could not be found. Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:07:51.488188 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34e95e11-1450-4d9b-bf94-3d03a5480108 could not be found. Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34e95e11-1450-4d9b-bf94-3d03a5480108 could not be found. Aug 24 17:07:51.490125 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:51.491617 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f4c6322f-e079-4b8d-834d-fe07279f5a74 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Returning 404 to user: Instance 34e95e11-1450-4d9b-bf94-3d03a5480108 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:07:51.491617 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f4c6322f-e079-4b8d-834d-fe07279f5a74 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108" status: 404 len: 111 microversion: 2.1 time: 0.030566 Aug 24 17:07:51.491617 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 638/1273] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:51 2022] GET /compute/v2.1/servers/34e95e11-1450-4d9b-bf94-3d03a5480108 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:07:54.292456 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-8ce7b747-0397-4b35-8abd-4763f850dfed tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] Calling method '.version_select at 0x7fa1954b1820>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:54.342094 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-8ce7b747-0397-4b35-8abd-4763f850dfed tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/9409963c-9420-4fd4-b08d-9f0d572d2d8d" status: 200 len: 350 microversion: 2.1 time: 0.053674 Aug 24 17:07:54.342673 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 636/1274] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 17:07:54 2022] GET /compute/v2.1/os-volumes/9409963c-9420-4fd4-b08d-9f0d572d2d8d => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:55.079602 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c835695c-b621-44e9-b963-1b1a1446b7e1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:55.083372 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c835695c-b621-44e9-b963-1b1a1446b7e1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:55.083520 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-44db98f7-7055-4c7a-b065-4102f7d89334 req-bf30eaf0-9317-4688-a394-b6d242358ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9708889-6063-4e38-91b9-0df38ddb6bd6", "tag": "f9ebb137-ae7c-4c7a-ad72-43d58a464bc1"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:07:55.086449 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c835695c-b621-44e9-b963-1b1a1446b7e1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:55.086935 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c835695c-b621-44e9-b963-1b1a1446b7e1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:55.087363 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c835695c-b621-44e9-b963-1b1a1446b7e1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:55.088156 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG dbcounter [-] [127715] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=127715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:55.088298 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c835695c-b621-44e9-b963-1b1a1446b7e1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:55.088682 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c835695c-b621-44e9-b963-1b1a1446b7e1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:55.089090 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c835695c-b621-44e9-b963-1b1a1446b7e1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:55.096952 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-44db98f7-7055-4c7a-b065-4102f7d89334 req-bf30eaf0-9317-4688-a394-b6d242358ef1 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:55.097519 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-44db98f7-7055-4c7a-b065-4102f7d89334 req-bf30eaf0-9317-4688-a394-b6d242358ef1 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:55.098027 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-44db98f7-7055-4c7a-b065-4102f7d89334 req-bf30eaf0-9317-4688-a394-b6d242358ef1 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:55.108932 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-44db98f7-7055-4c7a-b065-4102f7d89334 req-bf30eaf0-9317-4688-a394-b6d242358ef1 service nova] Creating event network-changed:f9ebb137-ae7c-4c7a-ad72-43d58a464bc1 for instance a9708889-6063-4e38-91b9-0df38ddb6bd6 on hv-cinder-85220 Aug 24 17:07:55.114394 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-44db98f7-7055-4c7a-b065-4102f7d89334 req-bf30eaf0-9317-4688-a394-b6d242358ef1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035900 Aug 24 17:07:55.115002 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 637/1275] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:55.117112 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c835695c-b621-44e9-b963-1b1a1446b7e1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:07:55.405827 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c835695c-b621-44e9-b963-1b1a1446b7e1 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 204 len: 0 microversion: 2.1 time: 0.330069 Aug 24 17:07:55.406621 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 639/1276] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 17:07:55 2022] DELETE /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:07:55.417234 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-9eb090fc-ce1c-41d6-95f6-f4da0667c0a8 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:55.418511 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-9eb090fc-ce1c-41d6-95f6-f4da0667c0a8 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:55.425905 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9eb090fc-ce1c-41d6-95f6-f4da0667c0a8 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:55.426703 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9eb090fc-ce1c-41d6-95f6-f4da0667c0a8 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:55.427183 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9eb090fc-ce1c-41d6-95f6-f4da0667c0a8 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:55.428264 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9eb090fc-ce1c-41d6-95f6-f4da0667c0a8 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:55.429116 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9eb090fc-ce1c-41d6-95f6-f4da0667c0a8 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:55.429750 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-9eb090fc-ce1c-41d6-95f6-f4da0667c0a8 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:55.751254 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-9eb090fc-ce1c-41d6-95f6-f4da0667c0a8 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:07:55.759996 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-9eb090fc-ce1c-41d6-95f6-f4da0667c0a8 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1575 microversion: 2.1 time: 0.348181 Aug 24 17:07:55.760723 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 638/1277] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:55 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1575 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:07:56.020436 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-34377963-6c5a-4faa-9121-551f17121f8d tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] Calling method '.version_select at 0x7fa194b75160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:56.066852 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-34377963-6c5a-4faa-9121-551f17121f8d tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/96c2d52e-5162-4c32-95bd-19ce46c840cd" status: 200 len: 350 microversion: 2.1 time: 0.050558 Aug 24 17:07:56.067425 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 640/1278] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 17:07:56 2022] GET /compute/v2.1/os-volumes/96c2d52e-5162-4c32-95bd-19ce46c840cd => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:56.780989 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-89aa16e3-0ee6-4316-bffa-3e9ba6fb9086 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:56.781598 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-89aa16e3-0ee6-4316-bffa-3e9ba6fb9086 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:56.788127 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89aa16e3-0ee6-4316-bffa-3e9ba6fb9086 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:56.788649 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89aa16e3-0ee6-4316-bffa-3e9ba6fb9086 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:56.789088 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89aa16e3-0ee6-4316-bffa-3e9ba6fb9086 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:56.789776 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89aa16e3-0ee6-4316-bffa-3e9ba6fb9086 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:56.790234 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89aa16e3-0ee6-4316-bffa-3e9ba6fb9086 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:56.790662 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-89aa16e3-0ee6-4316-bffa-3e9ba6fb9086 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:56.924773 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-89aa16e3-0ee6-4316-bffa-3e9ba6fb9086 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:07:56.933248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-89aa16e3-0ee6-4316-bffa-3e9ba6fb9086 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1458 microversion: 2.1 time: 0.156169 Aug 24 17:07:56.933803 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 639/1279] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:56 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1458 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:07:57.634252 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-14eab35d-ad8f-4785-88d6-16b5e77c0156 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] Calling method '.version_select at 0x7fa194aa0160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:57.638942 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [req-c271acab-3ce3-4926-b681-86d03e0c2319 req-285112e8-22ae-4146-bf52-3413685b5306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9708889-6063-4e38-91b9-0df38ddb6bd6", "name": "network-vif-deleted", "tag": "f9ebb137-ae7c-4c7a-ad72-43d58a464bc1"}]} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:07:57.648996 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-c271acab-3ce3-4926-b681-86d03e0c2319 req-285112e8-22ae-4146-bf52-3413685b5306 service nova] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:57.649541 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-c271acab-3ce3-4926-b681-86d03e0c2319 req-285112e8-22ae-4146-bf52-3413685b5306 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:57.649971 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [req-c271acab-3ce3-4926-b681-86d03e0c2319 req-285112e8-22ae-4146-bf52-3413685b5306 service nova] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:57.660941 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.compute.server_external_events [req-c271acab-3ce3-4926-b681-86d03e0c2319 req-285112e8-22ae-4146-bf52-3413685b5306 service nova] Creating event network-vif-deleted:f9ebb137-ae7c-4c7a-ad72-43d58a464bc1 for instance a9708889-6063-4e38-91b9-0df38ddb6bd6 on hv-cinder-85220 Aug 24 17:07:57.666104 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [req-c271acab-3ce3-4926-b681-86d03e0c2319 req-285112e8-22ae-4146-bf52-3413685b5306 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030795 Aug 24 17:07:57.667241 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 640/1280] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Aug 24 17:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:57.753111 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-14eab35d-ad8f-4785-88d6-16b5e77c0156 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/7e2c2658-033b-474f-9ec9-39c96fcfcfe1" status: 200 len: 351 microversion: 2.1 time: 0.128576 Aug 24 17:07:57.753717 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 641/1281] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 17:07:57 2022] GET /compute/v2.1/os-volumes/7e2c2658-033b-474f-9ec9-39c96fcfcfe1 => generated 351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:57.767485 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-352c32ff-de6f-4adf-a2ed-76a5356da523 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] Calling method '.version_select at 0x7fa195451ca0>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:57.850342 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-352c32ff-de6f-4adf-a2ed-76a5356da523 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086940 Aug 24 17:07:57.851072 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 641/1282] 10.222.0.70 () {58 vars in 1134 bytes} [Wed Aug 24 17:07:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:07:57.864979 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d11492b5-ef63-49e4-aa85-fa6d4fa499c4 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] Calling method '.version_select at 0x7fa194aa0ca0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:57.951047 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d11492b5-ef63-49e4-aa85-fa6d4fa499c4 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089764 Aug 24 17:07:57.956501 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 642/1283] 10.222.0.70 () {58 vars in 1149 bytes} [Wed Aug 24 17:07:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:57.956702 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-ba92ceb2-a15c-4c99-b0f4-c135f5183907 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:57.956702 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-ba92ceb2-a15c-4c99-b0f4-c135f5183907 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:57.962850 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ba92ceb2-a15c-4c99-b0f4-c135f5183907 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:57.963342 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ba92ceb2-a15c-4c99-b0f4-c135f5183907 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:57.963798 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ba92ceb2-a15c-4c99-b0f4-c135f5183907 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:57.964758 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ba92ceb2-a15c-4c99-b0f4-c135f5183907 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:57.965154 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ba92ceb2-a15c-4c99-b0f4-c135f5183907 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:57.965580 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-ba92ceb2-a15c-4c99-b0f4-c135f5183907 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:57.966456 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ca81c174-78a7-4ebf-9b91-7ed4a1d2c249 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] Calling method '.version_select at 0x7fa1992b2670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:58.053900 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ca81c174-78a7-4ebf-9b91-7ed4a1d2c249 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090961 Aug 24 17:07:58.054036 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.policy [None req-ba92ceb2-a15c-4c99-b0f4-c135f5183907 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701be5a3cff34016ab22b6dc4d23d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805d6de24ff4415c89cba2d318ffd2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127715) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:07:58.054469 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 643/1284] 10.222.0.70 () {58 vars in 1134 bytes} [Wed Aug 24 17:07:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:07:58.064146 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-ba92ceb2-a15c-4c99-b0f4-c135f5183907 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 200 len: 1225 microversion: 2.1 time: 0.113270 Aug 24 17:07:58.067959 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6480469b-3ab6-4b46-8003-f77d07efdb11 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] Calling method '.version_select at 0x7fa19918fdc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:58.076610 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 642/1285] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:57 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:07:58.152302 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6480469b-3ab6-4b46-8003-f77d07efdb11 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088440 Aug 24 17:07:58.152905 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 644/1286] 10.222.0.70 () {58 vars in 1167 bytes} [Wed Aug 24 17:07:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:07:58.166193 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-7e8c5a9b-46d2-4f77-be07-aae4b4d31736 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] Calling method '.version_select at 0x7fa1955ef820>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:58.262454 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-7e8c5a9b-46d2-4f77-be07-aae4b4d31736 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.100169 Aug 24 17:07:58.263034 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 643/1287] 10.222.0.70 () {58 vars in 1170 bytes} [Wed Aug 24 17:07:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:58.276634 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f6773775-efcf-40a7-9f7a-2f3e72df28f1 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] Calling method '.version_select at 0x7fa19918fd30>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:58.355692 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f6773775-efcf-40a7-9f7a-2f3e72df28f1 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083387 Aug 24 17:07:58.356269 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 645/1288] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Aug 24 17:07:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:07:58.368804 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-c7264e96-169f-4374-b59e-f5dd67c0d749 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] Calling method '.version_select at 0x7fa19530b820>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:58.453458 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-c7264e96-169f-4374-b59e-f5dd67c0d749 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088338 Aug 24 17:07:58.454076 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 644/1289] 10.222.0.70 () {58 vars in 1188 bytes} [Wed Aug 24 17:07:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:07:58.467295 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6f7e959a-1730-4484-b1f7-fdd810130273 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] Calling method '.version_select at 0x7fa194b75f70>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:58.548595 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6f7e959a-1730-4484-b1f7-fdd810130273 tempest-VolumesTestJSON-1238866875 tempest-VolumesTestJSON-1238866875-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085502 Aug 24 17:07:58.549194 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 646/1290] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Aug 24 17:07:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:07:59.083774 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5bf593d5-a957-4596-bd5b-e730307dc9f5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:59.084377 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-5bf593d5-a957-4596-bd5b-e730307dc9f5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: a9708889-6063-4e38-91b9-0df38ddb6bd6] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:59.091351 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5bf593d5-a957-4596-bd5b-e730307dc9f5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:59.091829 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5bf593d5-a957-4596-bd5b-e730307dc9f5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:59.092263 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5bf593d5-a957-4596-bd5b-e730307dc9f5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:59.093005 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5bf593d5-a957-4596-bd5b-e730307dc9f5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:59.093456 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5bf593d5-a957-4596-bd5b-e730307dc9f5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:59.093878 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-5bf593d5-a957-4596-bd5b-e730307dc9f5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:59.107368 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-5bf593d5-a957-4596-bd5b-e730307dc9f5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] HTTP exception thrown: Instance a9708889-6063-4e38-91b9-0df38ddb6bd6 could not be found. Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5bf593d5-a957-4596-bd5b-e730307dc9f5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Request method failure captured: Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 HTTP/1.1 Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlijBbk2OFKfNW9n0JDtNbrOD1V5gSg_Z7lqVZ0UtERqNjaty6_5Fsg-xF4h7HqVMhCWZMh7YeuHNGU66z_YHZyvqKrBbHCMhFWp_j7qLSDUBTwDVxsIdAriuN7ViyOVkCR6jAC6X-6GoHuLVM7bG1Z7kifFnKa-ZNuAUGeSja66JLc Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 805d6de24ff4415c89cba2d318ffd2f4 Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 17:07:59.109050 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 17:07:59.110864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:07:59.110864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:07:59.110864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 805d6de24ff4415c89cba2d318ffd2f4 Aug 24 17:07:59.110864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:07:59.110864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-TestVolumeBootPattern-1985410155-project Aug 24 17:07:59.110864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 17:07:59.110864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 17:07:59.110864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 701be5a3cff34016ab22b6dc4d23d939 Aug 24 17:07:59.110864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-TestVolumeBootPattern-1985410155-project Aug 24 17:07:59.110864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 17:07:59.110864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance a9708889-6063-4e38-91b9-0df38ddb6bd6 could not be found. Aug 24 17:07:59.110864 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': 'a9708889-6063-4e38-91b9-0df38ddb6bd6'} Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9708889-6063-4e38-91b9-0df38ddb6bd6 could not be found. Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:07:59.111917 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9708889-6063-4e38-91b9-0df38ddb6bd6 could not be found. Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9708889-6063-4e38-91b9-0df38ddb6bd6 could not be found. Aug 24 17:07:59.113581 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.115248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-5bf593d5-a957-4596-bd5b-e730307dc9f5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Returning 404 to user: Instance a9708889-6063-4e38-91b9-0df38ddb6bd6 could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:07:59.115248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-5bf593d5-a957-4596-bd5b-e730307dc9f5 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6" status: 404 len: 111 microversion: 2.1 time: 0.030455 Aug 24 17:07:59.115248 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 645/1291] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:59 2022] GET /compute/v2.1/servers/a9708889-6063-4e38-91b9-0df38ddb6bd6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:07:59.603789 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-87bb2e65-a62d-47ad-8b98-77af342592b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:59.604972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-87bb2e65-a62d-47ad-8b98-77af342592b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:59.610956 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87bb2e65-a62d-47ad-8b98-77af342592b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:59.611438 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87bb2e65-a62d-47ad-8b98-77af342592b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:59.611872 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87bb2e65-a62d-47ad-8b98-77af342592b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:59.612601 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87bb2e65-a62d-47ad-8b98-77af342592b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:59.613058 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87bb2e65-a62d-47ad-8b98-77af342592b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:59.613507 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87bb2e65-a62d-47ad-8b98-77af342592b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:59.627449 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-87bb2e65-a62d-47ad-8b98-77af342592b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] HTTP exception thrown: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-87bb2e65-a62d-47ad-8b98-77af342592b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Request method failure captured: Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: DELETE /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf HTTP/1.1 Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlijBbk2OFKfNW9n0JDtNbrOD1V5gSg_Z7lqVZ0UtERqNjaty6_5Fsg-xF4h7HqVMhCWZMh7YeuHNGU66z_YHZyvqKrBbHCMhFWp_j7qLSDUBTwDVxsIdAriuN7ViyOVkCR6jAC6X-6GoHuLVM7bG1Z7kifFnKa-ZNuAUGeSja66JLc Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 805d6de24ff4415c89cba2d318ffd2f4 Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 17:07:59.629113 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 17:07:59.630862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:07:59.630862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:07:59.630862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 805d6de24ff4415c89cba2d318ffd2f4 Aug 24 17:07:59.630862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:07:59.630862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-TestVolumeBootPattern-1985410155-project Aug 24 17:07:59.630862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 17:07:59.630862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 17:07:59.630862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: 701be5a3cff34016ab22b6dc4d23d939 Aug 24 17:07:59.630862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-TestVolumeBootPattern-1985410155-project Aug 24 17:07:59.630862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: > Aug 24 17:07:59.630862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:07:59.630862 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': '63aaebc2-8a55-4615-a3e7-7ac0dca58edf'} Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:07:59.631914 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:07:59.633641 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.635910 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-87bb2e65-a62d-47ad-8b98-77af342592b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Returning 404 to user: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:07:59.635910 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-87bb2e65-a62d-47ad-8b98-77af342592b9 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "DELETE /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 404 len: 111 microversion: 2.1 time: 0.031217 Aug 24 17:07:59.635910 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 647/1292] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Aug 24 17:07:59 2022] DELETE /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:07:59.639900 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-080d8b8c-ba20-4bec-9ac0-75f7510b7172 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:07:59.640553 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.compute.api [None req-080d8b8c-ba20-4bec-9ac0-75f7510b7172 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] [instance: 63aaebc2-8a55-4615-a3e7-7ac0dca58edf] Fetching instance by UUID {{(pid=127715) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:07:59.646757 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-080d8b8c-ba20-4bec-9ac0-75f7510b7172 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:59.647240 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-080d8b8c-ba20-4bec-9ac0-75f7510b7172 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:59.647678 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-080d8b8c-ba20-4bec-9ac0-75f7510b7172 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:59.648515 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-080d8b8c-ba20-4bec-9ac0-75f7510b7172 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Acquiring lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:07:59.650123 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-080d8b8c-ba20-4bec-9ac0-75f7510b7172 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:07:59.650608 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG oslo_concurrency.lockutils [None req-080d8b8c-ba20-4bec-9ac0-75f7510b7172 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Lock "4623f5b3-2ee5-42d8-a47e-5245b061e1ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:07:59.664170 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-080d8b8c-ba20-4bec-9ac0-75f7510b7172 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] HTTP exception thrown: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-080d8b8c-ba20-4bec-9ac0-75f7510b7172 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Request method failure captured: Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf HTTP/1.1 Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlijBbk2OFKfNW9n0JDtNbrOD1V5gSg_Z7lqVZ0UtERqNjaty6_5Fsg-xF4h7HqVMhCWZMh7YeuHNGU66z_YHZyvqKrBbHCMhFWp_j7qLSDUBTwDVxsIdAriuN7ViyOVkCR6jAC6X-6GoHuLVM7bG1Z7kifFnKa-ZNuAUGeSja66JLc Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 805d6de24ff4415c89cba2d318ffd2f4 Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 17:07:59.665763 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 17:07:59.667383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/805d6de24ff4415c89cba2d318ffd2f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:07:59.667383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:07:59.667383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 805d6de24ff4415c89cba2d318ffd2f4 Aug 24 17:07:59.667383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-TestVolumeBootPattern-1985410155 Aug 24 17:07:59.667383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-TestVolumeBootPattern-1985410155-project Aug 24 17:07:59.667383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 17:07:59.667383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 17:07:59.667383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: 701be5a3cff34016ab22b6dc4d23d939 Aug 24 17:07:59.667383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-TestVolumeBootPattern-1985410155-project Aug 24 17:07:59.667383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: > Aug 24 17:07:59.667383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:07:59.667383 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': '63aaebc2-8a55-4615-a3e7-7ac0dca58edf'} Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:07:59.668287 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. Aug 24 17:07:59.670110 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:07:59.671369 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-080d8b8c-ba20-4bec-9ac0-75f7510b7172 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Returning 404 to user: Instance 63aaebc2-8a55-4615-a3e7-7ac0dca58edf could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:07:59.671369 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-080d8b8c-ba20-4bec-9ac0-75f7510b7172 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf" status: 404 len: 111 microversion: 2.1 time: 0.031922 Aug 24 17:07:59.671369 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 646/1293] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Aug 24 17:07:59 2022] GET /compute/v2.1/servers/63aaebc2-8a55-4615-a3e7-7ac0dca58edf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:08:01.192660 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a089addc-6e06-4be9-8a68-88d03e6c3ac6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] Calling method '.version_select at 0x7fa194b75f70>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:08:01.309331 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a089addc-6e06-4be9-8a68-88d03e6c3ac6 tempest-TestVolumeBootPattern-1985410155 tempest-TestVolumeBootPattern-1985410155-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1973815301" status: 202 len: 0 microversion: 2.1 time: 0.120413 Aug 24 17:08:01.309855 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 648/1294] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Aug 24 17:08:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1973815301 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:08:04.623505 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-28146796-4d7a-4ef6-b5b0-3c82e28e5dec tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Action: 'create', calling method: .version_select at 0x7fa1955ca430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-474417888", "metadata": {"Type": "work"}}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-28146796-4d7a-4ef6-b5b0-3c82e28e5dec tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Request method failure captured: Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 121 Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlr0u0_NyrsCt8RAd2LP-WCmuUpCPqDS7LVlEpjjJDSiTDS9fHZ6gb3I_Yi-_mAbrX7uwzziRiEnAKJeFG8ZbH_0KPRVEK9nDRvNal5QbwK3lcjh5p2pu1SzbKb9NakVuQCHLP7G-IFfjjULin9YKrakRSfSDRQnZwohhZGeJkZxuYk Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 07aa12bfd07e487e83c90306d83164f1 Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 17:08:04.637262 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 17:08:04.639081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:08:04.639081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.639081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 07aa12bfd07e487e83c90306d83164f1 Aug 24 17:08:04.639081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.639081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-VolumesNegativeTest-2014701889-project Aug 24 17:08:04.639081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 17:08:04.639081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 17:08:04.639081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: bed4f57d853d460b8ed1ad622040538b Aug 24 17:08:04.639081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-VolumesNegativeTest-2014701889-project Aug 24 17:08:04.639081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Aug 24 17:08:04.639081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-474417888", "metadata": {"Type": "work"}}} Aug 24 17:08:04.639081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: Aug 24 17:08:04.639081 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-474417888', 'metadata': {'Type': 'work'}}}} Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:08:04.640253 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:08:04.643198 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:08:04.645430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:08:04.645430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.645430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-28146796-4d7a-4ef6-b5b0-3c82e28e5dec tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:08:04.645430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-28146796-4d7a-4ef6-b5b0-3c82e28e5dec tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.163817 Aug 24 17:08:04.645430 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 647/1295] 10.222.0.70 () {60 vars in 1156 bytes} [Wed Aug 24 17:08:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:08:04.650269 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b039e06e-3d97-443c-aa0d-088ad5ee6e0d tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Action: 'create', calling method: .version_select at 0x7fa19452b940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-306302006", "metadata": {"Type": "work"}}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b039e06e-3d97-443c-aa0d-088ad5ee6e0d tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Request method failure captured: Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 119 Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlr0u0_NyrsCt8RAd2LP-WCmuUpCPqDS7LVlEpjjJDSiTDS9fHZ6gb3I_Yi-_mAbrX7uwzziRiEnAKJeFG8ZbH_0KPRVEK9nDRvNal5QbwK3lcjh5p2pu1SzbKb9NakVuQCHLP7G-IFfjjULin9YKrakRSfSDRQnZwohhZGeJkZxuYk Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 07aa12bfd07e487e83c90306d83164f1 Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 17:08:04.657545 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 17:08:04.659223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:08:04.659223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.659223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 07aa12bfd07e487e83c90306d83164f1 Aug 24 17:08:04.659223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.659223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-VolumesNegativeTest-2014701889-project Aug 24 17:08:04.659223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 17:08:04.659223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 17:08:04.659223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: bed4f57d853d460b8ed1ad622040538b Aug 24 17:08:04.659223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-VolumesNegativeTest-2014701889-project Aug 24 17:08:04.659223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Aug 24 17:08:04.659223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-306302006", "metadata": {"Type": "work"}}} Aug 24 17:08:04.659223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: Aug 24 17:08:04.659223 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-306302006', 'metadata': {'Type': 'work'}}}} Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi '0' Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:08:04.660164 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:08:04.661788 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:08:04.663133 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:08:04.663133 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.663133 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b039e06e-3d97-443c-aa0d-088ad5ee6e0d tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:08:04.663133 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b039e06e-3d97-443c-aa0d-088ad5ee6e0d tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013011 Aug 24 17:08:04.665176 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 649/1296] 10.222.0.70 () {60 vars in 1156 bytes} [Wed Aug 24 17:08:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:08:04.670416 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-297513b3-efee-492f-83f4-0e3ac1808fdb tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Action: 'create', calling method: .version_select at 0x7fa194a1fa60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1186113408", "metadata": {"Type": "work"}}} {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-297513b3-efee-492f-83f4-0e3ac1808fdb tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Request method failure captured: Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 119 Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlr0u0_NyrsCt8RAd2LP-WCmuUpCPqDS7LVlEpjjJDSiTDS9fHZ6gb3I_Yi-_mAbrX7uwzziRiEnAKJeFG8ZbH_0KPRVEK9nDRvNal5QbwK3lcjh5p2pu1SzbKb9NakVuQCHLP7G-IFfjjULin9YKrakRSfSDRQnZwohhZGeJkZxuYk Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 07aa12bfd07e487e83c90306d83164f1 Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 17:08:04.675810 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 17:08:04.677445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:08:04.677445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.677445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 07aa12bfd07e487e83c90306d83164f1 Aug 24 17:08:04.677445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.677445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-VolumesNegativeTest-2014701889-project Aug 24 17:08:04.677445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 17:08:04.677445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 17:08:04.677445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: bed4f57d853d460b8ed1ad622040538b Aug 24 17:08:04.677445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-VolumesNegativeTest-2014701889-project Aug 24 17:08:04.677445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Aug 24 17:08:04.677445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1186113408", "metadata": {"Type": "work"}}} Aug 24 17:08:04.677445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: Aug 24 17:08:04.677445 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1186113408', 'metadata': {'Type': 'work'}}}} Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi '' Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:08:04.683384 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:08:04.685373 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:08:04.686767 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:08:04.686767 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.686767 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-297513b3-efee-492f-83f4-0e3ac1808fdb tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:08:04.686767 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-297513b3-efee-492f-83f4-0e3ac1808fdb tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010977 Aug 24 17:08:04.686767 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 648/1297] 10.222.0.70 () {60 vars in 1156 bytes} [Wed Aug 24 17:08:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 17:08:04.706723 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b1697de0-3a99-456c-bc8b-b41cb44fcaea tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Calling method '.version_select at 0x7fa194523670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:08:04.738806 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-b1697de0-3a99-456c-bc8b-b41cb44fcaea tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] HTTP exception thrown: Volume tempest-invalid-684488067 could not be found. Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b1697de0-3a99-456c-bc8b-b41cb44fcaea tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Request method failure captured: Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-684488067 HTTP/1.1 Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlr0u0_NyrsCt8RAd2LP-WCmuUpCPqDS7LVlEpjjJDSiTDS9fHZ6gb3I_Yi-_mAbrX7uwzziRiEnAKJeFG8ZbH_0KPRVEK9nDRvNal5QbwK3lcjh5p2pu1SzbKb9NakVuQCHLP7G-IFfjjULin9YKrakRSfSDRQnZwohhZGeJkZxuYk Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 07aa12bfd07e487e83c90306d83164f1 Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 17:08:04.740994 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 17:08:04.742481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:08:04.742481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.742481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 07aa12bfd07e487e83c90306d83164f1 Aug 24 17:08:04.742481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.742481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-VolumesNegativeTest-2014701889-project Aug 24 17:08:04.742481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 17:08:04.742481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 17:08:04.742481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: bed4f57d853d460b8ed1ad622040538b Aug 24 17:08:04.742481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-VolumesNegativeTest-2014701889-project Aug 24 17:08:04.742481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: Aug 24 17:08:04.742481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Volume tempest-invalid-684488067 could not be found. Aug 24 17:08:04.742481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': 'tempest-invalid-684488067'} Aug 24 17:08:04.742481 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-684488067 could not be found. (HTTP 404) (Request-ID: req-815ae27d-c541-4389-bce4-0717306a74bb) Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.743458 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:08:04.745655 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-684488067 could not be found. Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:08:04.747067 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-684488067 could not be found. Aug 24 17:08:04.748638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.748638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.748638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.748638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.748638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:08:04.748638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:08:04.748638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:08:04.748638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:08:04.748638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-684488067 could not be found. Aug 24 17:08:04.748638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.748638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b1697de0-3a99-456c-bc8b-b41cb44fcaea tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Returning 404 to user: Volume tempest-invalid-684488067 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:08:04.748638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b1697de0-3a99-456c-bc8b-b41cb44fcaea tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-684488067" status: 404 len: 98 microversion: 2.1 time: 0.051109 Aug 24 17:08:04.748638 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 650/1298] 10.222.0.70 () {58 vars in 1215 bytes} [Wed Aug 24 17:08:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-684488067 => generated 98 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 17:08:04.755021 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-0aa1c6b6-1ed9-4c8e-9922-597e88a53a67 tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004035 Aug 24 17:08:04.757983 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 649/1299] 10.222.0.70 () {58 vars in 1140 bytes} [Wed Aug 24 17:08:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 17:08:04.766294 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5ee14f74-9aab-4940-895b-46cc5629ef31 tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004060 Aug 24 17:08:04.766889 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 651/1300] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Aug 24 17:08:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 17:08:04.776013 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-58f2e172-5af0-46b9-9e93-c8ee66efb5d1 tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Calling method '.version_select at 0x7fa195451ee0>' {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:08:04.804313 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.wsgi [None req-58f2e172-5af0-46b9-9e93-c8ee66efb5d1 tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] HTTP exception thrown: Volume c667a7cb-dabc-4ca9-84d7-f3e3a3e5a2b7 could not be found. Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-58f2e172-5af0-46b9-9e93-c8ee66efb5d1 tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Request method failure captured: Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: request: DELETE /compute/v2.1/os-volumes/c667a7cb-dabc-4ca9-84d7-f3e3a3e5a2b7 HTTP/1.1 Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept: application/json Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Accept-Encoding: identity Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Connection: close Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Length: 0 Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Content-Type: application/json Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Host: 10.222.0.70 Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Openstack-System-Scope: None Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: User-Agent: python-urllib3/1.26.11 Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Auth-Token: gAAAAABjBlr0u0_NyrsCt8RAd2LP-WCmuUpCPqDS7LVlEpjjJDSiTDS9fHZ6gb3I_Yi-_mAbrX7uwzziRiEnAKJeFG8ZbH_0KPRVEK9nDRvNal5QbwK3lcjh5p2pu1SzbKb9NakVuQCHLP7G-IFfjjULin9YKrakRSfSDRQnZwohhZGeJkZxuYk Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Id: None Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Domain-Name: None Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Identity-Status: Confirmed Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Is-Admin-Project: True Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Id: default Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Domain-Name: Default Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Id: 07aa12bfd07e487e83c90306d83164f1 Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Project-Name: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Role: reader,member Aug 24 17:08:04.806563 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Roles: reader,member Aug 24 17:08:04.808769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:08:04.808769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.808769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Id: 07aa12bfd07e487e83c90306d83164f1 Aug 24 17:08:04.808769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-Tenant-Name: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.808769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User: tempest-VolumesNegativeTest-2014701889-project Aug 24 17:08:04.808769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Id: default Aug 24 17:08:04.808769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Domain-Name: Default Aug 24 17:08:04.808769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Id: bed4f57d853d460b8ed1ad622040538b Aug 24 17:08:04.808769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: X-User-Name: tempest-VolumesNegativeTest-2014701889-project Aug 24 17:08:04.808769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: method: Aug 24 17:08:04.808769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: exception: Volume c667a7cb-dabc-4ca9-84d7-f3e3a3e5a2b7 could not be found. Aug 24 17:08:04.808769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: action_args: {'id': 'c667a7cb-dabc-4ca9-84d7-f3e3a3e5a2b7'} Aug 24 17:08:04.808769 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: {{(pid=127715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c667a7cb-dabc-4ca9-84d7-f3e3a3e5a2b7 could not be found. (HTTP 404) (Request-ID: req-9602e631-d7d0-4f1f-867a-eb44e0b1907a) Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.813480 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:08:04.815223 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c667a7cb-dabc-4ca9-84d7-f3e3a3e5a2b7 could not be found. Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:08:04.816889 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c667a7cb-dabc-4ca9-84d7-f3e3a3e5a2b7 could not be found. Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c667a7cb-dabc-4ca9-84d7-f3e3a3e5a2b7 could not be found. Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: DEBUG nova.api.openstack.wsgi [None req-58f2e172-5af0-46b9-9e93-c8ee66efb5d1 tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Returning 404 to user: Volume c667a7cb-dabc-4ca9-84d7-f3e3a3e5a2b7 could not be found. {{(pid=127715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO nova.api.openstack.requestlog [None req-58f2e172-5af0-46b9-9e93-c8ee66efb5d1 tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/c667a7cb-dabc-4ca9-84d7-f3e3a3e5a2b7" status: 404 len: 109 microversion: 2.1 time: 0.036514 Aug 24 17:08:04.818417 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: [pid: 127715|app: 0|req: 650/1301] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Aug 24 17:08:04 2022] DELETE /compute/v2.1/os-volumes/c667a7cb-dabc-4ca9-84d7-f3e3a3e5a2b7 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:08:04.819624 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bb54718e-0814-405f-ab3a-e32f83267d27 tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Calling method '.version_select at 0x7fa194b24d30>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:08:04.846972 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-bb54718e-0814-405f-ab3a-e32f83267d27 tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] HTTP exception thrown: Volume cad757a6-f601-4df6-b3e7-6e4828b9bbe0 could not be found. Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bb54718e-0814-405f-ab3a-e32f83267d27 tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Request method failure captured: Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: request: GET /compute/v2.1/os-volumes/cad757a6-f601-4df6-b3e7-6e4828b9bbe0 HTTP/1.1 Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept: application/json Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Accept-Encoding: identity Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Connection: close Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Length: 0 Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Content-Type: application/json Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Host: 10.222.0.70 Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Openstack-System-Scope: None Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: User-Agent: python-urllib3/1.26.11 Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Auth-Token: gAAAAABjBlr0u0_NyrsCt8RAd2LP-WCmuUpCPqDS7LVlEpjjJDSiTDS9fHZ6gb3I_Yi-_mAbrX7uwzziRiEnAKJeFG8ZbH_0KPRVEK9nDRvNal5QbwK3lcjh5p2pu1SzbKb9NakVuQCHLP7G-IFfjjULin9YKrakRSfSDRQnZwohhZGeJkZxuYk Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Id: None Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Domain-Name: None Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Identity-Status: Confirmed Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Is-Admin-Project: True Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Id: default Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Domain-Name: Default Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Id: 07aa12bfd07e487e83c90306d83164f1 Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Project-Name: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Role: reader,member Aug 24 17:08:04.849146 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Roles: reader,member Aug 24 17:08:04.850896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/07aa12bfd07e487e83c90306d83164f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}] Aug 24 17:08:04.850896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.850896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Id: 07aa12bfd07e487e83c90306d83164f1 Aug 24 17:08:04.850896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-Tenant-Name: tempest-VolumesNegativeTest-2014701889 Aug 24 17:08:04.850896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User: tempest-VolumesNegativeTest-2014701889-project Aug 24 17:08:04.850896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Id: default Aug 24 17:08:04.850896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Domain-Name: Default Aug 24 17:08:04.850896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Id: bed4f57d853d460b8ed1ad622040538b Aug 24 17:08:04.850896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: X-User-Name: tempest-VolumesNegativeTest-2014701889-project Aug 24 17:08:04.850896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: method: Aug 24 17:08:04.850896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: exception: Volume cad757a6-f601-4df6-b3e7-6e4828b9bbe0 could not be found. Aug 24 17:08:04.850896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: action_args: {'id': 'cad757a6-f601-4df6-b3e7-6e4828b9bbe0'} Aug 24 17:08:04.850896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cad757a6-f601-4df6-b3e7-6e4828b9bbe0 could not be found. (HTTP 404) (Request-ID: req-edb6f791-c82c-4347-808c-192c1c5775d7) Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.852417 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:08:04.853771 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cad757a6-f601-4df6-b3e7-6e4828b9bbe0 could not be found. Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:08:04.855613 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cad757a6-f601-4df6-b3e7-6e4828b9bbe0 could not be found. Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cad757a6-f601-4df6-b3e7-6e4828b9bbe0 could not be found. Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: ERROR nova.api.openstack.wsgi Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bb54718e-0814-405f-ab3a-e32f83267d27 tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] Returning 404 to user: Volume cad757a6-f601-4df6-b3e7-6e4828b9bbe0 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bb54718e-0814-405f-ab3a-e32f83267d27 tempest-VolumesNegativeTest-2014701889 tempest-VolumesNegativeTest-2014701889-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/cad757a6-f601-4df6-b3e7-6e4828b9bbe0" status: 404 len: 109 microversion: 2.1 time: 0.036703 Aug 24 17:08:04.866554 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 652/1302] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Aug 24 17:08:04 2022] GET /compute/v2.1/os-volumes/cad757a6-f601-4df6-b3e7-6e4828b9bbe0 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:08:08.743755 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:08:08.744513 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Wed Aug 24 17:08:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:08:12.853559 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:08:12.854171 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Wed Aug 24 17:08:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:08:14.885267 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:08:14.885898 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Wed Aug 24 17:08:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:11:28.751896 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:11:28.752531 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Wed Aug 24 17:11:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:11:32.864815 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:11:32.865418 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Wed Aug 24 17:11:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:11:34.895063 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:11:34.895706 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Wed Aug 24 17:11:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:13:09.559966 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:13:09.560495 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Wed Aug 24 17:13:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:13:23.534823 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:13:23.535447 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Wed Aug 24 17:13:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:13:42.237376 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:13:42.237853 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Wed Aug 24 17:13:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:14:48.760639 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:14:48.761355 dv-cinder-852208-9-iscsi devstack@n-api.service[127716]: Wed Aug 24 17:14:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:14:52.873086 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:14:52.873690 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Wed Aug 24 17:14:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:14:54.903358 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:14:54.903988 dv-cinder-852208-9-iscsi devstack@n-api.service[127715]: Wed Aug 24 17:14:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!